00000001:02000400:0.0F:1788869193.163298:0:3304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788869209.765212:0:3525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788869211.560221:0:3568:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 703 MB/s 00000001:01000000:2.0F:1788869211.810203:0:3568:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 727 MB/s 00000001:01000000:3.0:1788869212.059687:0:3568:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5795 MB/s 00000020:02000000:0.0:1788869212.848056:0:3616:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g331ba7d 00000400:02000000:3.0:1788869214.084331:0:3631:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.154@tcp [8/256/0/180] 00008000:02000000:0.0:1788869217.604254:0:3781:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788869289.348301:0:5751:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788869303.351784:0:6501:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788869303.351790:0:6501:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788869303.351791:0:6501:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788869303.354087:0:6501:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002281ebf4 00000080:02000400:2.0:1788869303.354103:0:6501:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788869303.361243:0:6501:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788869303.361258:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788869303.361298:0:6501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004454fcb8) 00000020:00000080:2.0:1788869303.361319:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0F:1788869303.451006:0:6501:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788869303.451132:0:6501:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788869303.466988:0:6501:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788869303.467228:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788869303.467236:0:6501:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788869303.467247:0:6501:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6ce38e 00000020:01000004:3.0:1788869303.467254:0:6501:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788869303.467259:0:6501:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788869303.467263:0:6501:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002281ebf4 from MGS 00000020:01000004:3.0:1788869303.467267:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788869303.467285:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005b84775e) 00000020:00000080:3.0:1788869303.467297:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788869303.467368:0:6501:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002281ebf4 from MGS, refs=2 00080000:01000000:3.0:1788869303.467374:0:6501:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788869303.467379:0:6501:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6ce39c 00000100:00100000:3.0:1788869303.467475:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788869303.467742:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788869303.467750:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788869303.469806:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788869303.469825:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788869303.470866:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869303.471079:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788869303.471094:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788869303.475411:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788869303.475426:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788869303.476545:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788869303.476555:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788869303.477443:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869303.477448:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869303.477450:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869303.478246:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869303.478250:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869303.478251:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869303.480691:0:6501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788869303.498180:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788869303.733783:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2561 MB/s 00000001:01000000:2.0:1788869303.984376:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2575 MB/s 00000001:01000000:3.0:1788869304.234457:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 743 MB/s 00000001:01000000:2.0:1788869304.484028:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 687 MB/s 00080000:10000000:1.0:1788869304.497113:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1788869304.514084:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788869304.516152:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788869304.516219:0:6501:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788869304.516267:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788869304.516540:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788869304.516563:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788869304.517086:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869304.517243:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788869304.517249:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:3.0:1788869304.521436:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869304.527652:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788869304.527672:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788869304.529019:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788869304.529033:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788869304.533038:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:3.0:1788869304.533215:0:6520:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1788869304.533242:0:6501:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:2.0:1788869304.533247:0:6501:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788869304.533307:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:2.0:1788869304.533323:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (000000008706231f) 00000020:00000080:2.0:1788869304.533341:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788869304.533445:0:6501:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000030e452d2@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869304.533871:0:6501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:2.0:1788869304.533879:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788869304.535075:0:6521:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788869304.535120:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39) 00000020:00000080:2.0:1788869304.535139:0:6501:0:(genops.c:1384:class_connect()) connect: client 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39, cookie 0x4c16c38a9b6ce3aa 00000100:00080000:2.0:1788869304.535154:0:6501:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869304.535163:0:6501:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import 0000000030e452d2 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869304.535208:0:6501:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f7e96d28 x1875765324939392/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869304.535236:0:6501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS 00000020:01000004:2.0:1788869304.535261:0:6501:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788869304.535266:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788869304.535279:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000eaa4d7e3) 00000020:00000080:2.0:1788869304.535291:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788869304.535955:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7e96d28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3647:1875765324939392:0@lo:250: 00000100:00100000:1.0:1788869304.536046:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.536121:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324939392 00000100:00100000:1.0:1788869304.536130:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324939392 00000100:00100000:1.0:1788869304.536172:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869304.536179:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000075001c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1875765324939392:12345-0@lo:250: 00010000:00080000:1.0:1788869304.536206:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1788869304.536236:0:6516:0:(genops.c:1384:class_connect()) connect: client 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39, cookie 0x4c16c38a9b6ce3b8 00000100:00080000:1.0:1788869304.536402:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000a668f177 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869304.536703:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000075001c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:3647:x1875765324939392:12345-0@lo:250: Request processed in 524us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869304.536712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869304.536762:0:3647:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788869304.536771:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:1.0:1788869304.536779:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788869304.536784:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788869304.536796:0:3647:0:(import.c:65:import_set_state_nolock()) 0000000030e452d2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788869304.536799:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788869304.536808:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788869304.536813:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7e96d28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3647:1875765324939392:0@lo:250: 00000100:00100000:2.0:1788869304.570311:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869304.570526:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788869304.570532:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788869304.573992:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788869304.574005:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788869304.574959:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788869304.574969:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788869304.575944:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869304.576131:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788869304.576137:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788869304.577365:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788869304.577375:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788869304.626943:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869304.627186:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788869304.627192:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788869304.631896:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788869304.631921:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788869304.634113:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869304.634300:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788869304.634306:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788869304.634991:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788869304.634999:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788869304.636050:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869304.636236:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788869304.636242:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788869304.637125:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788869304.637134:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788869304.640617:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869304.640798:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788869304.640805:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788869304.641380:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788869304.641390:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788869304.673907:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869304.674184:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788869304.674192:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788869304.678283:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788869304.678305:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788869304.685752:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788869304.685773:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788869304.686737:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788869304.686777:0:6501:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788869304.686786:0:6501:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788869304.686939:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788869304.686981:0:6501:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788869304.686986:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788869304.686988:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869304.686990:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869304.686991:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869304.686993:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869304.686994:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869304.686995:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869304.686997:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869304.686998:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869304.686999:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869304.687001:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869304.687003:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869304.687005:0:6501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788869304.687008:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869304.687009:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869304.687010:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869304.687012:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869304.687013:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869304.687014:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869304.687015:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869304.687016:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869304.687017:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869304.687018:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869304.687019:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869304.687020:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869304.687078:0:6501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788869304.687098:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000061cf5c44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324939520:0@lo:253: 00000100:00100000:3.0:1788869304.687184:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869304.687240:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 0000000091e4de11 going to sleep for 11 seconds 00000100:00100000:2.0:1788869304.687360:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324939520 00000100:00100000:2.0:1788869304.687369:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324939520 00000100:00100000:2.0:1788869304.687422:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869304.687431:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:6501:x1875765324939520:12345-0@lo:253: 20000000:01000000:2.0:1788869304.687485:0:6519:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788869304.687487:0:6519:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788869304.688643:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788869304.688731:0:6519:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788869304.689087:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869304.690024:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788869304.690228:0:6519:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788869304.690232:0:6519:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788869304.690238:0:6519:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788869304.690241:0:6519:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788869304.690254:0:6519:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788869304.690391:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869304.690554:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788869304.690568:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788869304.690608:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788869304.690630:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788869304.690662:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788869304.690714:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788869304.690723:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788869304.690736:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788869304.690742:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788869304.690753:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788869304.690758:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788869304.690770:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788869304.690786:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788869304.690807:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788869304.690811:0:6519:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788869304.690817:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869304.690901:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788869304.690911:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788869304.690925:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788869304.690940:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788869304.690959:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788869304.690968:0:6519:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788869304.690991:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788869304.690998:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788869304.691010:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788869304.691024:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788869304.691037:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788869304.691045:0:6519:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788869304.691065:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788869304.691073:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788869304.691085:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788869304.691113:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788869304.691179:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788869304.691202:0:6519:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788869304.691209:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788869304.693522:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788869304.693857:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788869304.693888:0:6519:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.154@tcp for mdt 20000000:01000000:2.0:1788869304.693890:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1788869304.693906:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788869304.693912:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788869304.693926:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788869304.693932:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1788869304.693944:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788869304.693967:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788869304.693983:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788869304.693999:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788869304.694031:0:6519:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788869304.694035:0:6519:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788869304.694039:0:6519:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788869304.694099:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788869304.694102:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788869304.694625:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788869304.694834:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788869304.694854:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788869304.694866:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788869304.694875:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788869304.694876:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788869304.695104:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788869304.695219:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788869304.695238:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788869304.695251:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788869304.695260:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869304.695263:0:6519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788869304.695267:0:6519:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788869304.695269:0:6519:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788869304.695273:0:6519:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788869304.695279:0:6519:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788869304.695547:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788869304.695698:0:6519:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788869304.703291:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788869304.703324:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788869304.703337:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788869304.703358:0:6519:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788869304.703378:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703394:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703404:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703410:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703415:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703422:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703444:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e9f4c3c already unused, calling callback (00000000c6f56d4a) 00010000:00010000:3.0:1788869304.703447:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703454:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703468:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703476:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.703481:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869304.703509:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788869304.713241:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:6501:x1875765324939520:12345-0@lo:253: Request processed in 25798us (26045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869304.713264:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869304.716099:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000061cf5c44 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324939520:0@lo:253: 10000000:01000000:2.0:1788869304.716125:0:6501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788869304.716129:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869304.716131:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869304.716132:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869304.716134:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788869304.716135:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869304.716136:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869304.716138:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869304.716139:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869304.716142:0:6501:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788869304.716143:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869304.716166:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788869304.716190:0:6501:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002281ebf4 from lustre-MDT0000 10000000:01000000:2.0:1788869304.716228:0:6501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788869304.716232:0:6501:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788869304.716237:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e282a933380 10000000:01000000:2.0:1788869304.716241:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869304.716249:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e282a933380 from 1 10000000:01000000:2.0:1788869304.716252:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788869304.716304:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.716315:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.716325:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869304.716344:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004148373e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324939648:0@lo:101: 00000100:00100000:2.0:1788869304.716457:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.716533:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000427dc673 going to sleep for 11 seconds 00000100:00100000:1.0:1788869304.716610:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324939648 00000100:00100000:1.0:1788869304.716623:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324939648 00000100:00100000:1.0:1788869304.716682:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869304.716690:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c50295f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:6501:x1875765324939648:12345-0@lo:101: 00010000:00010000:1.0:1788869304.716707:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869304.716726:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce3c6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.716751:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce3c6 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.716763:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce3c6 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.716773:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b225a37a, rc 0) 00000100:00100000:1.0:1788869304.716830:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c50295f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:6501:x1875765324939648:12345-0@lo:101: Request processed in 141us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869304.716837:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869304.717417:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004148373e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324939648:0@lo:101: 00010000:00010000:2.0:1788869304.717435:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.717445:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869304.717522:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004148373e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324939776:0@lo:501: 00000100:00100000:2.0:1788869304.717560:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.717630:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000427dc673 going to sleep for 11 seconds 00000100:00100000:3.0:1788869304.717641:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324939776 00000100:00100000:3.0:1788869304.717649:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324939776 00000100:00100000:3.0:1788869304.717690:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869304.717698:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b262c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:6501:x1875765324939776:12345-0@lo:501: 00000100:00100000:3.0:1788869304.717800:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b262c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:6501:x1875765324939776:12345-0@lo:501: Request processed in 103us (240us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869304.717809:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869304.718131:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004148373e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324939776:0@lo:501: 10000000:01000000:1.0:1788869304.718164:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788869304.718183:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.718308:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869304.718324:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e281757b800 10000000:01000000:1.0:1788869304.718329:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788869304.718333:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e281757b800 10000000:01000000:1.0:1788869304.718336:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788869304.718339:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e281757b800 from 1 10000000:01000000:1.0:1788869304.718342:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788869304.718388:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000002401debd/0x4c16c38a9b6ce3d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.718396:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000002401debd/0x4c16c38a9b6ce3d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.718404:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000002401debd/0x4c16c38a9b6ce3d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869304.718416:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324939904:0@lo:101: 00000100:00100000:1.0:1788869304.718448:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.718480:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9ae6ac3 going to sleep for 11 seconds 00000100:00100000:3.0:1788869304.718530:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324939904 00000100:00100000:3.0:1788869304.718540:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324939904 00000100:00100000:3.0:1788869304.718580:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869304.718621:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db0061c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:6501:x1875765324939904:12345-0@lo:101: 00010000:00010000:3.0:1788869304.718629:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869304.718642:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce3d4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.718660:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce3d4 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.718668:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e9f4c3c/0x4c16c38a9b6ce3db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce3d4 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.718675:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e9f4c3c, rc 0) 00000100:00100000:3.0:1788869304.718712:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db0061c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+7:6501:x1875765324939904:12345-0@lo:101: Request processed in 127us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869304.718718:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869304.719115:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324939904:0@lo:101: 00010000:00010000:1.0:1788869304.719127:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000002401debd/0x4c16c38a9b6ce3d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.719134:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000002401debd/0x4c16c38a9b6ce3d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869304.719148:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788869304.719161:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000002401debd/0x4c16c38a9b6ce3d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.719179:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000002401debd/0x4c16c38a9b6ce3d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869304.719186:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788869304.719315:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869304.719321:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e281757b800 10000000:01000000:1.0:1788869304.719325:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788869304.719328:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788869304.719330:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869304.719349:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.719356:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.719363:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869304.719375:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940032:0@lo:101: 00000100:00100000:1.0:1788869304.719407:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.719449:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324940032 00000100:00100000:1.0:1788869304.719450:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9ae6ac3 going to sleep for 11 seconds 00000100:00100000:2.0:1788869304.719457:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324940032 00000100:00100000:2.0:1788869304.719510:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869304.719517:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c610da85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+7:6501:x1875765324940032:12345-0@lo:101: 00010000:00010000:2.0:1788869304.719527:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869304.719540:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce3e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.719554:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce3e2 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.719562:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce3e2 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.719568:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000063579a33, rc 0) 00000100:00100000:2.0:1788869304.719630:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c610da85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+8:6501:x1875765324940032:12345-0@lo:101: Request processed in 114us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869304.719635:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869304.720318:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940032:0@lo:101: 00010000:00010000:1.0:1788869304.720334:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.720341:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869304.720417:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940160:0@lo:501: 00000100:00100000:1.0:1788869304.720464:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.720519:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324940160 00000100:00100000:2.0:1788869304.720525:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324940160 00000100:00100000:2.0:1788869304.720573:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869304.720580:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000001a3a608 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+8:6501:x1875765324940160:12345-0@lo:501: 00000100:00100000:2.0:1788869304.720712:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000001a3a608 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:6501:x1875765324940160:12345-0@lo:501: Request processed in 133us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869304.720719:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869304.720757:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9ae6ac3 going to sleep for 11 seconds 00000100:00100000:1.0:1788869304.720773:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940160:0@lo:501: 00000100:00100000:1.0:1788869304.720801:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940288:0@lo:503: 00000100:00100000:1.0:1788869304.720849:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.720873:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9ae6ac3 going to sleep for 11 seconds 00000100:00100000:3.0:1788869304.720906:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324940288 00000100:00100000:3.0:1788869304.720911:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324940288 00000100:00100000:3.0:1788869304.720940:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869304.720946:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d08fe554 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:6501:x1875765324940288:12345-0@lo:503: 00000100:00100000:3.0:1788869304.721036:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d08fe554 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:6501:x1875765324940288:12345-0@lo:503: Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869304.721043:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869304.721271:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940288:0@lo:503: 00000100:00100000:2.0:1788869304.722018:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000323db9bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6546:1875765324940416:0@lo:502: 00000100:00100000:2.0:1788869304.722073:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.722111:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f27faa8 going to sleep for 11 seconds 00000100:00100000:3.0:1788869304.724817:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324940416 00000100:00100000:3.0:1788869304.724838:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324940416 00000100:00100000:3.0:1788869304.724907:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869304.724916:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003eb8bb4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:6546:x1875765324940416:12345-0@lo:502: 00000100:00100000:3.0:1788869304.725114:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003eb8bb4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:6546:x1875765324940416:12345-0@lo:502: Request processed in 199us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869304.725261:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869304.726965:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000323db9bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6546:1875765324940416:0@lo:502: 00000020:01000000:2.0:1788869304.727044:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869304.727059:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869304.727061:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788869304.727067:0:6546:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788869304.727071:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869304.727088:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ff7c69d2) 00000020:00000080:2.0:1788869304.727111:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788869304.727117:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788869304.727220:0:6546:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788869304.727228:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6ce3f7 00000020:00000080:2.0:1788869304.727459:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788869304.727464:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869304.727469:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869304.727470:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788869304.727473:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869304.727477:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869304.727479:0:6546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788869304.727482:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869304.727508:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003ca32648) 00000020:00000080:2.0:1788869304.727521:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788869304.727527:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788869304.727529:0:6546:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788869304.727531:0:6546:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788869304.727537:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788869304.727576:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002281ebf4 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788869304.727622:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000064e34ddc) 00000020:00000080:2.0:1788869304.727631:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788869304.727773:0:6546:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788869304.727780:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6ce40c 00000020:00000080:2.0:1788869304.727882:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788869304.727889:0:6546:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788869304.727895:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4c16c38a9b6ce413 00080000:01000000:2.0:1788869304.727901:0:6546:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788869304.727910:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6ce41a 00080000:10000000:2.0:1788869304.728325:0:6546:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788869304.728460:0:6546:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788869304.734337:0:6546:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788869304.816991:0:6546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788869304.818249:0:6546:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788869304.824202:0:6546:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788869304.824675:0:6546:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788869304.829290:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000eaac8cea) 00000020:00000080:3.0:1788869304.829313:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788869304.829397:0:6546:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788869304.829407:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6ce428 00000020:00000080:3.0:1788869304.831061:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788869304.834350:0:6546:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788869304.837865:0:6546:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788869304.840951:0:6546:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1788869304.845449:0:6546:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788869304.847566:0:6546:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788869304.853864:0:6546:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788869304.856341:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4c16c38a9b6ce42f 00000020:00000080:2.0:1788869304.857379:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788869304.857396:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869304.857402:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869304.857405:0:6546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788869304.857408:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869304.857412:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869304.857413:0:6546:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869304.857416:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869304.857417:0:6546:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788869304.857420:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869304.857422:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869304.857423:0:6546:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788869304.857425:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869304.857430:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869304.857431:0:6546:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788869304.857435:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788869304.857472:0:6546:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788869304.857541:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000323db9bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6546:1875765324940544:0@lo:502: 00000100:00100000:2.0:1788869304.857667:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.857723:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f6e1fc8 going to sleep for 11 seconds 00000100:00100000:3.0:1788869304.862742:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324940544 00000100:00100000:3.0:1788869304.862762:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324940544 00000100:00100000:3.0:1788869304.862824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869304.862834:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009741e56e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:6546:x1875765324940544:12345-0@lo:502: 00000100:00100000:3.0:1788869304.863025:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009741e56e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:6546:x1875765324940544:12345-0@lo:502: Request processed in 193us (5358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869304.863040:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869304.863235:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000323db9bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6546:1875765324940544:0@lo:502: 00000020:01000000:0.0:1788869304.863271:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869304.863278:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869304.863291:0:6546:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788869304.863296:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788869304.863570:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788869304.863613:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788869304.863634:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.863645:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869304.863653:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e281757b800 from 1 10000000:01000000:1.0:1788869304.863656:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788869304.863688:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.863695:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.863703:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869304.863732:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940672:0@lo:101: 00000100:00100000:1.0:1788869304.863786:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.863819:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9ef9952 going to sleep for 11 seconds 00000100:00100000:3.0:1788869304.864901:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324940672 00000100:00100000:3.0:1788869304.864915:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324940672 00000100:00100000:3.0:1788869304.864974:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869304.864982:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2f8496 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:6501:x1875765324940672:12345-0@lo:101: 00010000:00010000:3.0:1788869304.864996:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869304.865013:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce436 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.865060:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce436 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.865082:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce436 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.865091:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee8b2e0f, rc 0) 00000100:00100000:3.0:1788869304.865164:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2f8496 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:6501:x1875765324940672:12345-0@lo:101: Request processed in 183us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869304.865170:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869304.865797:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940672:0@lo:101: 00010000:00010000:1.0:1788869304.865817:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.865826:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869304.866362:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940800:0@lo:256: 00000100:00100000:1.0:1788869304.866556:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.866665:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9ef9952 going to sleep for 11 seconds 00000100:00100000:2.0:1788869304.868277:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324940800 00000100:00100000:2.0:1788869304.868295:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324940800 00000100:00100000:2.0:1788869304.868355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869304.868363:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e90e4dc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:6501:x1875765324940800:12345-0@lo:256: 20000000:01000000:2.0:1788869304.868475:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788869304.868484:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788869304.868832:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e90e4dc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:6501:x1875765324940800:12345-0@lo:256: Request processed in 469us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869304.868842:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869304.869909:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940800:0@lo:256: 10000000:01000000:1.0:1788869304.870482:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869304.870550:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.870561:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869304.870571:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e281757b800 from 1 10000000:01000000:1.0:1788869304.870573:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869304.870649:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.870657:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.870677:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869304.870694:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940928:0@lo:101: 00000100:00100000:1.0:1788869304.870748:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.870791:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9ef9952 going to sleep for 11 seconds 00000100:00100000:0.0:1788869304.870994:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324940928 00000100:00100000:0.0:1788869304.871003:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324940928 00000100:00100000:0.0:1788869304.871072:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869304.871083:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000082978b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:6501:x1875765324940928:12345-0@lo:101: 00010000:00010000:0.0:1788869304.871096:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869304.871109:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce444 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869304.871136:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce444 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869304.871145:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce444 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869304.871153:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ad331d5, rc 0) 00000100:00100000:0.0:1788869304.871195:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000082978b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:6501:x1875765324940928:12345-0@lo:101: Request processed in 114us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869304.871203:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869304.871285:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324940928:0@lo:101: 00010000:00010000:1.0:1788869304.871295:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.871304:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869304.871362:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941056:0@lo:501: 00000100:00100000:1.0:1788869304.871391:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.871580:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9ef9952 going to sleep for 11 seconds 00000100:00100000:0.0:1788869304.871771:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324941056 00000100:00100000:0.0:1788869304.871785:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324941056 00000100:00100000:0.0:1788869304.871867:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869304.871874:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000874ff5df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:6501:x1875765324941056:12345-0@lo:501: 00000100:00100000:0.0:1788869304.872093:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000874ff5df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:6501:x1875765324941056:12345-0@lo:501: Request processed in 220us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869304.872101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869304.872473:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941056:0@lo:501: 00000100:00100000:1.0:1788869304.872521:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941184:0@lo:503: 00000100:00100000:1.0:1788869304.872566:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.872667:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9ef9952 going to sleep for 11 seconds 00000100:00100000:0.0:1788869304.872762:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324941184 00000100:00100000:0.0:1788869304.872766:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324941184 00000100:00100000:0.0:1788869304.872799:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869304.872804:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e4200c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:6501:x1875765324941184:12345-0@lo:503: 00000040:00080000:0.0:1788869304.872840:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869304.872914:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e4200c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:6501:x1875765324941184:12345-0@lo:503: Request processed in 110us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869304.872920:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869304.873062:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009372105d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941184:0@lo:503: 00000040:00080000:0.0:1788869304.874080:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788869304.874301:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788869304.874321:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869304.874375:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.874388:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869304.874452:0:6501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788869304.874456:0:6501:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e281757b800 10000000:01000000:2.0:1788869304.874459:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e281757b800 10000000:01000000:2.0:1788869304.874464:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869304.874471:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e281757b800 from 1 10000000:01000000:2.0:1788869304.874474:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869304.874521:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.874528:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.874538:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869304.874556:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941312:0@lo:101: 00000100:00100000:2.0:1788869304.874651:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.874685:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cb108f0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869304.874812:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324941312 00000100:00100000:0.0:1788869304.874819:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324941312 00000100:00100000:0.0:1788869304.874855:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788869304.874862:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001209df1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:6501:x1875765324941312:12345-0@lo:101: 00010000:00010000:0.0:1788869304.874873:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869304.874884:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce452 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869304.874904:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce452 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869304.874913:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce452 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869304.874932:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e316dec, rc 0) 00000100:00100000:0.0:1788869304.874974:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001209df1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6501:x1875765324941312:12345-0@lo:101: Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869304.874981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869304.875169:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941312:0@lo:101: 00010000:00010000:2.0:1788869304.875183:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869304.875191:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869304.875242:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941440:0@lo:501: 00000100:00100000:2.0:1788869304.875268:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.875294:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cb108f0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869304.875340:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324941440 00000100:00100000:3.0:1788869304.875345:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324941440 00000100:00100000:3.0:1788869304.875379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869304.875385:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052ade774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6501:x1875765324941440:12345-0@lo:501: 00000100:00100000:0.0:1788869304.876310:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052ade774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6501:x1875765324941440:12345-0@lo:501: Request processed in 918us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869304.876320:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869304.876390:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941440:0@lo:501: 00000100:00100000:2.0:1788869304.876552:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941568:0@lo:503: 00000100:00100000:2.0:1788869304.876757:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.876834:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cb108f0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869304.876880:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324941568 00000100:00100000:3.0:1788869304.876887:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324941568 00000100:00100000:3.0:1788869304.876952:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869304.876959:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e4869f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6501:x1875765324941568:12345-0@lo:503: 00000100:00100000:3.0:1788869304.877060:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e4869f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6501:x1875765324941568:12345-0@lo:503: Request processed in 102us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869304.877067:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869304.877131:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324941568:0@lo:503: 00000100:00100000:2.0:1788869304.877441:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6551:1875765324941696:0@lo:502: 00000100:00100000:2.0:1788869304.877474:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869304.877816:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021d27ce0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869304.877903:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324941696 00000100:00100000:0.0:1788869304.877909:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324941696 00000100:00100000:0.0:1788869304.877936:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869304.877941:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089ac8e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6551:x1875765324941696:12345-0@lo:502: 00000100:00100000:0.0:1788869304.878042:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089ac8e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6551:x1875765324941696:12345-0@lo:502: Request processed in 100us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869304.878048:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869304.878123:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6551:1875765324941696:0@lo:502: 00000020:01000004:2.0:1788869304.878175:0:6551:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788869304.878190:0:6551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000036d06ed9) 00000020:00000080:2.0:1788869304.878208:0:6551:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788869304.878302:0:6551:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002281ebf4 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788869304.878306:0:6551:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002281ebf4 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788869304.878315:0:6551:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002281ebf4 4 00010000:00080000:2.0:1788869304.878341:0:6551:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000aba2ac54@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869304.880941:0:6551:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788869304.881209:0:6551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788869304.881256:0:6551:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869304.881271:0:6551:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4c16c38a9b6ce467 00000100:00080000:2.0:1788869304.881285:0:6551:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869304.881296:0:6551:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aba2ac54 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869304.881338:0:6551:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007b250fbb x1875765324941824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869304.881365:0:6551:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788869304.881836:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765324941824:0@lo:38: 00000100:00100000:1.0:1788869304.881928:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.882325:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000489cb877 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6551:1875765324941952:0@lo:502: 00000100:00100000:1.0:1788869304.882370:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.882395:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324941952 00000100:00100000:1.0:1788869304.882637:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324941952 00000100:00100000:1.0:1788869304.882681:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869304.882690:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001792b1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6551:x1875765324941952:12345-0@lo:502: 00000100:00100000:1.0:1788869304.882817:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001792b1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6551:x1875765324941952:12345-0@lo:502: Request processed in 128us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869304.882825:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869304.882867:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set 00000000783d0ea8 going to sleep for 11 seconds 00000100:00100000:1.0:1788869304.882889:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000489cb877 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6551:1875765324941952:0@lo:502: 00000040:00080000:1.0:1788869304.882915:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788869304.884557:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788869304.884614:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869304.884633:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.884649:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788869304.884718:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788869304.884721:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869304.884722:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869304.884723:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869304.884725:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869304.884726:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869304.884727:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869304.884729:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869304.884730:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869304.884731:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869304.884733:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869304.884734:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869304.884739:0:6501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788869304.884742:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869304.884744:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869304.884745:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869304.884746:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869304.884747:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869304.884748:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869304.884749:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869304.884750:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869304.884751:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869304.884752:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869304.884753:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869304.884755:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869304.884782:0:6501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788869304.884803:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2164c17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324942080:0@lo:253: 00000100:00100000:3.0:1788869304.884876:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869304.884908:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d0a2503c going to sleep for 11 seconds 00000100:00100000:1.0:1788869304.886244:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324942080 00000100:00100000:1.0:1788869304.886259:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324942080 00000100:00100000:1.0:1788869304.886323:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869304.886332:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed0df46e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6501:x1875765324942080:12345-0@lo:253: 20000000:01000000:1.0:1788869304.886364:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788869304.886379:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788869304.887973:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324941824 00000100:00100000:2.0:1788869304.887991:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324941824 00000100:00100000:2.0:1788869304.888037:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869304.888043:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a094b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765324941824:12345-0@lo:38: 00000100:00100000:2.0:1788869304.888173:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a094b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765324941824:12345-0@lo:38: Request processed in 129us (6246us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788869304.888180:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869304.893599:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869304.893618:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000aba2ac54 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869304.893627:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788869304.893631:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b250fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765324941824:0@lo:38: 20000000:01000000:0.0:1788869304.897268:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788869304.897326:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788869304.897705:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed0df46e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6501:x1875765324942080:12345-0@lo:253: Request processed in 11370us (12824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869304.897721:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869304.897854:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2164c17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6501:1875765324942080:0@lo:253: 10000000:01000000:2.0:1788869304.897867:0:6501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788869304.897870:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869304.897872:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869304.897873:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869304.897875:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869304.897876:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869304.897877:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869304.897878:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869304.897879:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869304.897881:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869304.897881:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869304.897883:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869304.897896:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788869304.897909:0:6501:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788869304.900606:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788869304.900621:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788869304.900658:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.900685:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce436 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.900694:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.900748:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce436 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.900767:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce436 expref: 11 pid: 6518 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869304.900798:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000489cb877 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324942208:0@lo:104: 00000100:00100000:1.0:1788869304.900869:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.900920:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set 00000000783d0ea8 going to sleep for 11 seconds 00000100:00100000:0.0:1788869304.901801:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324942208 00000100:00100000:0.0:1788869304.901812:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324942208 00000100:00100000:0.0:1788869304.901864:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869304.901872:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa60bd02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6540:x1875765324942208:12345-0@lo:104: 00010000:00010000:0.0:1788869304.901888:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869304.901951:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869304.901966:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa60bd02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6540:x1875765324942208:12345-0@lo:104: Request processed in 94us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869304.901972:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869304.902070:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000489cb877 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324942208:0@lo:104: 00010000:00010000:1.0:1788869304.902087:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788869304.907318:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788869304.907526:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788869304.907772:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788869304.907912:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788869304.908091:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788869304.908264:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:3.0:1788869304.909373:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869304.909393:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.909418:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000346b579f already unused, calling callback (000000008cf644ed) 10000000:00010000:3.0:1788869304.909423:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.909435:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869304.909442:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869304.909449:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869304.909531:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.909538:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869304.909563:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.909570:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 00000000346b579f/0x4c16c38a9b6ce436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce43d expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869304.909632:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869304.909634:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869304.909636:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869304.909745:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324942336:0@lo:103: 00000100:00100000:3.0:1788869304.909825:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869304.913051:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324942336 00000100:00100000:1.0:1788869304.913069:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324942336 00010000:00010000:1.0:1788869304.913121:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce436 expref: 12 pid: 6518 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869304.913167:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869304.913175:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000777fc862 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:3649:x1875765324942336:12345-0@lo:103: 00010000:00010000:1.0:1788869304.913189:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869304.913195:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce436 expref: 12 pid: 6518 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913207:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce436 expref: 12 pid: 6518 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913223:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce43d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce436 expref: 12 pid: 6518 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913237:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913245:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788869304.913275:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012655653s 00010000:00010000:1.0:1788869304.913279:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913285:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913290:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913295:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913300:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000911f9c69 already unused, calling callback (00000000c6f56d4a) 00010000:00010000:1.0:1788869304.913304:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913311:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913325:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913336:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869304.913419:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000777fc862 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:3649:x1875765324942336:12345-0@lo:103: Request processed in 246us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869304.913427:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869304.913473:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324942336:0@lo:103: 00010000:00010000:1.0:1788869304.913763:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913779:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869304.913785:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce46e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788869304.915229:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788869304.916228:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788869304.916758:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788869304.916928:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788869304.917261:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788869304.917517:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788869304.923680:0:6501:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788869304.939819:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788869304.940027:0:6556:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788869304.940032:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788869304.940217:0:6557:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788869304.957538:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788869304.957709:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788869304.958118:0:6501:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788869304.958126:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788869304.958225:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869304.959208:0:6501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788869304.959798:0:6501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788869304.959836:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788869304.961181:0:6557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869304.976882:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788869304.977673:0:6501:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1788869304.977879:0:6557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788869304.977964:0:6557:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788869304.977968:0:6557:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788869304.982059:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788869304.982830:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788869304.983000:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788869304.984039:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788869304.984289:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788869304.984507:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788869304.984741:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788869304.984876:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788869304.985008:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788869304.985222:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788869304.985478:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788869304.985830:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788869304.985968:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788869304.986175:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788869304.986324:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788869304.986560:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788869304.987175:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788869304.987355:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788869304.987716:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788869304.987855:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788869304.987990:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788869304.988224:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788869304.988362:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788869304.988670:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788869304.988819:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788869304.988982:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788869304.989234:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788869304.989366:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788869304.989742:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788869304.989948:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788869304.990160:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788869304.990292:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788869304.990822:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788869304.994249:0:6501:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788869304.994292:0:6501:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9f681c7f988 00100000:10000000:3.0:1788869304.994301:0:6501:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788869304.995223:0:6501:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788869304.995249:0:6501:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788869304.995270:0:6501:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788869304.995293:0:6501:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788869304.996173:0:6501:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869304.996371:0:6501:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788869305.544248:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869306.566370:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869307.590743:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869308.614755:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869309.503229:0:6802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788869309.641151:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869310.277797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869310.277809:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788869310.277812:0:37:0:(import.c:65:import_set_state_nolock()) 00000000aba2ac54 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869310.277832:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aba2ac54 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869310.277852:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000016d342d x1875765324942592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869310.278075:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000806f6141 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324942464:0@lo:400: 00000100:00100000:2.0:1788869310.278143:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869310.278276:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000016d342d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765324942592:0@lo:38: 00000100:00100000:0.0:1788869310.278378:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869310.278479:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324942592 00000100:00100000:2.0:1788869310.278489:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324942592 00000100:00100000:2.0:1788869310.278531:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869310.278539:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d906e9d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765324942592:12345-0@lo:38: 00010000:00080000:2.0:1788869310.278569:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1788869310.278642:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4c16c38a9b6ce475 00000004:00100000:2.0:1788869310.278699:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869310.278823:0:6526:0:(import.c:65:import_set_state_nolock()) 000000002706e1a2 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869310.278877:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d906e9d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765324942592:12345-0@lo:38: Request processed in 337us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869310.278884:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788869310.278925:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000016d342d x1875765324942592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869310.278941:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788869310.278948:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788869310.278954:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869310.278956:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000aba2ac54 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869310.278961:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000016d342d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765324942592:0@lo:38: 00000100:00100000:3.0:1788869310.279218:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324942464 00000100:00100000:3.0:1788869310.279225:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324942464 00000100:00100000:3.0:1788869310.279266:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869310.279272:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094f553b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:3650:x1875765324942464:12345-0@lo:400: 00000100:00100000:3.0:1788869310.279324:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094f553b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:3650:x1875765324942464:12345-0@lo:400: Request processed in 52us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869310.279331:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869310.280274:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000806f6141 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324942464:0@lo:400: 00000020:00000004:0.0:1788869310.455156:0:6854:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869310.455348:0:6854:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869310.666660:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869311.686641:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788869312.329224:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869312.329233:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e281757b800 from 3 10000000:01000000:0.0:1788869312.329238:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869312.329290:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869312.329303:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869312.329313:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869312.329363:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ecd1cc2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324942720:0@lo:101: 00000100:00100000:0.0:1788869312.329426:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869312.329848:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006fc8947 going to sleep for 11 seconds 00000100:00100000:1.0:1788869312.334114:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324942720 00000100:00100000:1.0:1788869312.334130:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324942720 00000100:00100000:1.0:1788869312.334210:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869312.334219:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060e4e768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:6521:x1875765324942720:12345-0@lo:101: 00010000:00010000:1.0:1788869312.334241:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869312.334262:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce47c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869312.334292:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce47c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869312.334302:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce47c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869312.334309:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e4028ee, rc 0) 00000100:00100000:1.0:1788869312.334407:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060e4e768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6521:x1875765324942720:12345-0@lo:101: Request processed in 189us (4981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869312.334429:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869312.334788:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ecd1cc2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324942720:0@lo:101: 00010000:00010000:0.0:1788869312.334807:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869312.334816:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869312.334872:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ecd1cc2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324942848:0@lo:256: 00000100:00100000:0.0:1788869312.334909:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869312.334949:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006fc8947 going to sleep for 11 seconds 00000100:00100000:1.0:1788869312.335012:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324942848 00000100:00100000:1.0:1788869312.335017:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324942848 00000100:00100000:1.0:1788869312.335225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869312.335234:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000088261e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6521:x1875765324942848:12345-0@lo:256: 20000000:01000000:1.0:1788869312.335250:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788869312.335266:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788869312.335269:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788869312.335546:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000088261e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:6521:x1875765324942848:12345-0@lo:256: Request processed in 313us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869312.335558:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869312.335717:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ecd1cc2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324942848:0@lo:256: 10000000:01000000:2.0:1788869312.335762:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869312.335769:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869312.335777:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869312.712288:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869313.474580:0:6955:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869313.474809:0:6955:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869313.734534:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869314.761477:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869315.397864:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869315.397897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4276c60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324943104:0@lo:400: 00000100:00100000:0.0:1788869315.398023:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869315.398095:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324943104 00000100:00100000:0.0:1788869315.398104:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324943104 00000100:00100000:0.0:1788869315.398157:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869315.398164:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039d4a713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324943104:12345-0@lo:400: 00000100:00100000:0.0:1788869315.398223:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039d4a713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324943104:12345-0@lo:400: Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869315.398231:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788869315.398284:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b4276c60 x1875765324943104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869315.398308:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4276c60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324943104:0@lo:400: 00000100:00100000:2.0:1788869315.398847:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005566775 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324942976:0@lo:400: 00000100:00100000:2.0:1788869315.398898:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869315.399021:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324942976 00000100:00100000:0.0:1788869315.399027:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324942976 00000100:00100000:0.0:1788869315.399062:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869315.399068:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000046b6b7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:3651:x1875765324942976:12345-0@lo:400: 00000100:00100000:0.0:1788869315.399103:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000046b6b7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:3651:x1875765324942976:12345-0@lo:400: Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869315.399110:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869315.399138:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005566775 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324942976:0@lo:400: 00010000:00010000:3.0:1788869315.782855:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869316.808306:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869317.836447:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869318.854535:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869319.887988:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869320.518377:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005566775 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324943232:0@lo:400: 00000100:00100000:0.0:1788869320.518449:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869320.518510:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869320.518517:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4276c60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324943360:0@lo:400: 00000100:00100000:0.0:1788869320.518547:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869320.518574:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324943232 00000100:00100000:0.0:1788869320.518582:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324943232 00000100:00100000:0.0:1788869320.518661:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869320.518670:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe9f5526 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:3649:x1875765324943232:12345-0@lo:400: 00000100:00100000:0.0:1788869320.518715:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe9f5526 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:3649:x1875765324943232:12345-0@lo:400: Request processed in 47us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869320.518723:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869320.518750:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324943360 00000100:00100000:0.0:1788869320.518760:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324943360 00000100:00100000:0.0:1788869320.518782:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869320.518787:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fec63f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324943360:12345-0@lo:400: 00000100:00100000:0.0:1788869320.518818:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fec63f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324943360:12345-0@lo:400: Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869320.518824:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788869320.520091:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b4276c60 x1875765324943360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869320.520112:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4276c60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324943360:0@lo:400: 00000100:00100000:0.0:1788869320.520148:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005566775 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324943232:0@lo:400: 00010000:00010000:0.0:1788869320.906379:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869321.926621:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788869322.838905:0:7454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788869322.838909:0:7454:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788869322.838911:0:7454:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788869322.839059:0:7454:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001a2d9828 00000020:01000004:2.0:1788869322.839077:0:7454:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788869322.839102:0:7454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788869322.839118:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000002a406340) 00000020:00000080:2.0:1788869322.839135:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788869322.894379:0:7454:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788869322.894472:0:7454:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788869322.932130:0:7454:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788869322.932381:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788869322.932396:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788869322.932411:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6ce491 00000020:01000004:2.0:1788869322.932420:0:7454:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788869322.932446:0:7454:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788869322.932450:0:7454:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788869322.932458:0:7454:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788869322.932496:0:7454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788869322.932502:0:7454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00010000:00010000:1.0:1788869322.957977:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788869322.976091:0:7454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788869322.976137:0:7454:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788869322.976141:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788869322.976143:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869322.976145:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869322.976146:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869322.976147:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869322.976149:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869322.976150:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869322.976151:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869322.976153:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869322.976155:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869322.976317:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869322.976321:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788869322.976324:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869322.976326:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869322.976327:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869322.976328:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869322.976329:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869322.976330:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869322.976331:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869322.976332:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869322.976333:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869322.976334:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869322.976334:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869322.976364:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788869322.976382:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324943488:0@lo:253: 00000100:00100000:3.0:1788869322.976456:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869322.976526:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000091bc15ba going to sleep for 11 seconds 00000100:00100000:2.0:1788869322.976855:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324943488 00000100:00100000:2.0:1788869322.976864:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324943488 00000100:00100000:2.0:1788869322.976960:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869322.976972:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006da914af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324943488:12345-0@lo:253: 20000000:01000000:2.0:1788869322.977028:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788869322.977035:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788869322.977042:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788869322.977047:0:6518:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788869322.977094:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788869322.977385:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869322.977518:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788869322.977533:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788869322.977552:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788869322.977570:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788869322.977621:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788869322.977678:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788869322.977686:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788869322.977699:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788869322.977711:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788869322.977727:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788869322.977732:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788869322.978428:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788869322.978455:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788869322.978829:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788869322.978842:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1788869322.978858:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788869322.978864:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788869322.978876:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788869322.978881:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1788869322.978894:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788869322.978899:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788869322.978910:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788869322.978927:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788869322.978939:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788869322.979113:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788869322.979124:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788869322.979136:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788869322.979152:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788869322.979183:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788869322.979189:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788869322.979201:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788869322.979220:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788869322.979225:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788869322.979247:0:6518:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788869322.979254:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788869322.979886:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788869322.980188:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788869322.980210:0:6518:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.154@tcp for mdt 20000000:01000000:2.0:1788869322.980212:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1788869322.980239:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788869322.980245:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788869322.980259:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788869322.980265:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1788869322.980279:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788869322.980362:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788869322.980381:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788869322.980397:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788869322.980443:0:6518:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788869322.980452:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788869322.980947:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788869322.981211:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788869322.981227:0:6518:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.154@tcp for mdt 20000000:01000000:2.0:1788869322.981229:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1788869322.981243:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788869322.981249:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788869322.981263:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788869322.981268:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1788869322.981282:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788869322.981363:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788869322.981382:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788869322.981400:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788869322.981418:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788869322.981422:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788869322.981426:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788869322.981471:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788869322.981474:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869322.982067:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869322.982092:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869322.982108:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788869322.982266:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788869322.982356:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788869322.982384:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788869322.982395:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788869322.982397:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869322.982919:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869322.982941:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869322.982958:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788869322.983217:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788869322.983239:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788869322.983272:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788869322.983355:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788869322.983357:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869322.984080:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869322.984104:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869322.984118:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788869322.984277:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788869322.984370:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788869322.984387:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788869322.984401:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788869322.984404:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788869322.984409:0:6518:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788869322.984415:0:6518:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788869322.984885:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788869322.984996:0:6518:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788869322.996704:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788869322.997137:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.997170:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce3c6 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.997178:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce3e2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.997183:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce452 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.997189:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.997234:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce452 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.997250:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce452 expref: 12 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869322.997264:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb677d5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324943616:0@lo:104: 00000100:00100000:3.0:1788869322.997401:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869322.997507:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce3e2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.997515:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3e2 expref: 12 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869322.997522:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000269e18e4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324943744:0@lo:104: 00000100:00100000:3.0:1788869322.997558:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869322.997727:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce3c6 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.997735:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3c6 expref: 12 pid: 6518 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869322.997754:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c4631e5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324943872:0@lo:104: 00000100:00100000:3.0:1788869322.997777:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869322.997968:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324943616 00000100:00100000:1.0:1788869322.997976:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324943616 00000100:00100000:1.0:1788869322.998084:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324943744 00000100:00100000:1.0:1788869322.998088:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324943744 00000100:00100000:1.0:1788869322.998104:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869322.998111:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000847baba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6518:x1875765324943616:12345-0@lo:104: 00010000:00010000:1.0:1788869322.998124:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869322.998224:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869322.998230:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000847baba1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6518:x1875765324943616:12345-0@lo:104: Request processed in 120us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869322.998238:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869322.998264:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869322.998270:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000257e794c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6518:x1875765324943744:12345-0@lo:104: 00010000:00010000:1.0:1788869322.998276:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998359:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869322.998364:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998371:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000608fa9c already unused, calling callback (000000008cf644ed) 10000000:00010000:2.0:1788869322.998375:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998383:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869322.998389:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869322.998394:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869322.998430:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998437:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869322.998456:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998463:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce459 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998477:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869322.998479:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998484:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aaa714dc already unused, calling callback (000000008cf644ed) 10000000:00010000:2.0:1788869322.998486:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998492:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869322.998497:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869322.998501:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869322.998512:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998518:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869322.998531:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998545:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 00000000aaa714dc/0x4c16c38a9b6ce3e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce3e9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869322.998555:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869322.998557:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869322.998559:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869322.998582:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b987746 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324944000:0@lo:103: 00000100:00100000:2.0:1788869322.998647:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869322.998683:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025231b9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324944128:0@lo:103: 00000100:00100000:2.0:1788869322.998706:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869322.998928:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324944000 00000100:00100000:3.0:1788869322.998934:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324944000 00010000:00010000:3.0:1788869322.998955:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce452 expref: 13 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869322.998974:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324944128 00000100:00100000:3.0:1788869322.998976:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324944128 00010000:00010000:3.0:1788869322.998985:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3e2 expref: 14 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869322.999009:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869322.999014:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a6237ebb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:3651:x1875765324944000:12345-0@lo:103: 00010000:00010000:3.0:1788869322.999024:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869322.999028:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce452 expref: 14 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.999036:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce452 expref: 14 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.999051:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869322.999076:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a6237ebb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:3651:x1875765324944000:12345-0@lo:103: Request processed in 63us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869322.999089:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869322.999103:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869322.999108:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0d13bdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:3648:x1875765324944128:12345-0@lo:103: 00010000:00010000:3.0:1788869322.999115:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869322.999119:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3e2 expref: 13 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.999126:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3e2 expref: 13 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869322.999135:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869322.999173:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0d13bdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:3648:x1875765324944128:12345-0@lo:103: Request processed in 65us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869322.999179:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869322.999222:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b987746 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324944000:0@lo:103: 00000100:00100000:3.0:1788869322.999249:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000006fd1c384 going to sleep for 11 seconds 00010000:00010000:3.0:1788869322.999261:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e316dec/0x4c16c38a9b6ce459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce452 expref: 12 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869322.999270:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb677d5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324943616:0@lo:104: 00010000:00010000:3.0:1788869322.999278:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000063579a33/0x4c16c38a9b6ce3e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3e2 expref: 11 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869322.999296:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000269e18e4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324943744:0@lo:104: 00000100:00100000:3.0:1788869322.999319:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025231b9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324944128:0@lo:103: 00010000:00010000:1.0:1788869322.999553:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788869322.999560:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000257e794c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6518:x1875765324943744:12345-0@lo:104: Request processed in 1290us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869322.999566:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869322.999580:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324943872 00000100:00100000:1.0:1788869322.999583:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324943872 00000100:00100000:1.0:1788869322.999625:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869322.999630:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000608da95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6518:x1875765324943872:12345-0@lo:104: 00010000:00010000:1.0:1788869322.999638:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869322.999727:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c4631e5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324943872:0@lo:104: 00010000:00010000:3.0:1788869322.999765:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000011:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869323.000016:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000023:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d90752c already unused, calling callback (000000008cf644ed) 10000000:00010000:2.0:1788869323.000026:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000032:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869323.000038:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869323.000043:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869323.000077:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000093:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869323.000108:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000114:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce3c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce3cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.000133:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088ba0681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324944256:0@lo:103: 00000100:00100000:2.0:1788869323.000177:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.000211:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324944256 00000100:00100000:2.0:1788869323.000215:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324944256 00010000:00010000:2.0:1788869323.000230:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3c6 expref: 11 pid: 6518 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.000249:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869323.000255:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000098dd4c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:3649:x1875765324944256:12345-0@lo:103: 00010000:00010000:2.0:1788869323.000263:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869323.000266:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3c6 expref: 11 pid: 6518 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000273:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3c6 expref: 11 pid: 6518 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000443:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce3cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce3c6 expref: 11 pid: 6518 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000455:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000473:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000485:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000492:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000497:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000502:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000507:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee8b2e0f already unused, calling callback (00000000c6f56d4a) 00010000:00010000:2.0:1788869323.000510:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000516:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000535:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.000546:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869323.000577:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000098dd4c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:3649:x1875765324944256:12345-0@lo:103: Request processed in 322us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.000583:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869323.000633:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088ba0681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324944256:0@lo:103: 00010000:00010000:2.0:1788869323.000654:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869323.000655:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869323.000657:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869323.000723:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.000730:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.000735:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee8b2e0f/0x4c16c38a9b6ce498 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869323.000764:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:1.0:1788869323.003032:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788869323.003048:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000608da95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6518:x1875765324943872:12345-0@lo:104: Request processed in 3414us (5266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869323.003060:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788869323.003344:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869323.003566:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006da914af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:7454:x1875765324943488:12345-0@lo:253: Request processed in 26597us (27110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869323.003576:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869323.003754:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324943488:0@lo:253: 10000000:01000000:2.0:1788869323.003769:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788869323.003772:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869323.003774:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869323.003775:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869323.003776:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788869323.003777:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869323.003778:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869323.003779:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869323.003781:0:7454:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788869323.003782:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869323.003783:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788869323.003803:0:7454:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001a2d9828 from lustre-MDT0001 10000000:01000000:2.0:1788869323.003836:0:7454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788869323.003839:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788869323.003846:0:7454:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e282a933380 local copy 10000000:01000000:2.0:1788869323.003850:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788869323.003889:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.003900:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.003909:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.003928:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088ba0681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324944384:0@lo:101: 00000100:00100000:2.0:1788869323.003963:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.004010:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000009716df53 going to sleep for 11 seconds 00000100:00100000:3.0:1788869323.004190:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324944384 00000100:00100000:3.0:1788869323.004197:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324944384 00000100:00100000:3.0:1788869323.004245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869323.004254:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005af2d035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:7454:x1875765324944384:12345-0@lo:101: 00010000:00010000:3.0:1788869323.004267:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869323.004282:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002afe8117/0x4c16c38a9b6ce4a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce49f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.004424:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002afe8117/0x4c16c38a9b6ce4a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce49f expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.004434:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002afe8117/0x4c16c38a9b6ce4a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce49f expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.004442:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002afe8117, rc 0) 00000100:00100000:3.0:1788869323.004485:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005af2d035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:7454:x1875765324944384:12345-0@lo:101: Request processed in 233us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869323.004491:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869323.004559:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088ba0681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324944384:0@lo:101: 00010000:00010000:2.0:1788869323.004571:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.004578:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.004686:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088ba0681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324944512:0@lo:501: 00000100:00100000:2.0:1788869323.004713:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.004728:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000009716df53 going to sleep for 11 seconds 00000100:00100000:3.0:1788869323.004839:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324944512 00000100:00100000:3.0:1788869323.004844:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324944512 00000100:00100000:3.0:1788869323.004864:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869323.004870:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd1d682c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:7454:x1875765324944512:12345-0@lo:501: 00000100:00100000:3.0:1788869323.005202:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd1d682c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:7454:x1875765324944512:12345-0@lo:501: Request processed in 332us (488us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869323.005210:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869323.005263:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088ba0681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324944512:0@lo:501: 10000000:01000000:2.0:1788869323.005275:0:7454:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788869323.005374:0:7454:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788869323.005379:0:7454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.005386:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.005392:0:7454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.005447:0:7454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869323.005469:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e282daf5000 10000000:01000000:2.0:1788869323.005474:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788869323.005478:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e282a933380 10000000:01000000:2.0:1788869323.005480:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788869323.005483:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e282a933380 from 1 10000000:01000000:2.0:1788869323.005492:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788869323.005510:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000001d7241ba/0x4c16c38a9b6ce4ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.005517:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000001d7241ba/0x4c16c38a9b6ce4ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.005523:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000001d7241ba/0x4c16c38a9b6ce4ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.005536:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088ba0681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324944640:0@lo:101: 00000100:00100000:2.0:1788869323.005565:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.005753:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d286cbf going to sleep for 11 seconds 00010000:00010000:1.0:1788869323.005819:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869323.005825:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.005833:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004b2327c2 already unused, calling callback (000000008cf644ed) 10000000:00010000:1.0:1788869323.005836:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.005855:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869323.005862:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869323.005867:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869323.005885:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.005892:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788869323.005935:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788869323.005954:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.005961:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000004b2327c2/0x4c16c38a9b6ce49f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4c16c38a9b6ce4a6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.005977:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869323.005978:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869323.005980:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869323.006178:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000489cb877 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324944768:0@lo:103: 00000100:00100000:0.0:1788869323.006215:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.006266:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324944640 00000100:00100000:3.0:1788869323.006272:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324944640 00000100:00100000:3.0:1788869323.006431:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869323.006440:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e15ff520 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:7454:x1875765324944640:12345-0@lo:101: 00010000:00010000:3.0:1788869323.006451:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869323.006463:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006cbe5a1/0x4c16c38a9b6ce4b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce4ad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.006483:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006cbe5a1/0x4c16c38a9b6ce4b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce4ad expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.006492:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006cbe5a1/0x4c16c38a9b6ce4b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce4ad expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.006499:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006cbe5a1, rc 0) 00000100:00100000:3.0:1788869323.006540:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e15ff520 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:7454:x1875765324944640:12345-0@lo:101: Request processed in 103us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869323.006546:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869323.006883:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324944768 00000100:00100000:2.0:1788869323.006890:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324944768 00000100:00100000:2.0:1788869323.006931:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869323.006938:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005566775 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:3651:x1875765324944768:12345-0@lo:103: 00010000:00010000:2.0:1788869323.006948:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869323.006960:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002afe8117/0x4c16c38a9b6ce4a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce49f expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.006972:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869323.007121:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005566775 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:3651:x1875765324944768:12345-0@lo:103: Request processed in 183us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.007128:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869323.007195:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000489cb877 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324944768:0@lo:103: 00000100:00100000:0.0:1788869323.007364:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088ba0681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324944640:0@lo:101: 00010000:00010000:0.0:1788869323.007377:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000001d7241ba/0x4c16c38a9b6ce4ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4b4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869323.007391:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000001d7241ba/0x4c16c38a9b6ce4ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce4b4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869323.007409:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788869323.007460:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000001d7241ba/0x4c16c38a9b6ce4ad lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4b4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869323.007468:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000001d7241ba/0x4c16c38a9b6ce4ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4b4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869323.007479:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e282daf5000 10000000:01000000:0.0:1788869323.007484:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788869323.007490:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e282daf5000 from 1 10000000:01000000:0.0:1788869323.007492:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788869323.007512:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 0000000024c30469/0x4c16c38a9b6ce4bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869323.007519:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 0000000024c30469/0x4c16c38a9b6ce4bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869323.007527:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 0000000024c30469/0x4c16c38a9b6ce4bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869323.007542:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4276c60 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324944896:0@lo:101: 00000100:00100000:0.0:1788869323.007574:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869323.007636:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000001bc0be89 going to sleep for 11 seconds 00000100:00100000:1.0:1788869323.007697:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324944896 00000100:00100000:1.0:1788869323.007702:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324944896 00000100:00100000:1.0:1788869323.007746:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869323.007752:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003abf4382 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:7454:x1875765324944896:12345-0@lo:101: 00010000:00010000:1.0:1788869323.007763:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869323.007773:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce4c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce4bb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.007789:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce4c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce4bb expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.007804:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000911f9c69/0x4c16c38a9b6ce4c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce4bb expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.007811:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000911f9c69, rc 0) 00000100:00100000:1.0:1788869323.007846:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003abf4382 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:7454:x1875765324944896:12345-0@lo:101: Request processed in 95us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869323.007851:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869323.007978:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4276c60 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324944896:0@lo:101: 00010000:00010000:2.0:1788869323.008061:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 0000000024c30469/0x4c16c38a9b6ce4bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.008081:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 0000000024c30469/0x4c16c38a9b6ce4bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869323.008094:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788869323.008282:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 0000000024c30469/0x4c16c38a9b6ce4bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.008352:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 0000000024c30469/0x4c16c38a9b6ce4bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869323.008359:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788869323.008364:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869323.008368:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e282daf5000 10000000:01000000:2.0:1788869323.008372:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788869323.008375:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788869323.008377:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788869323.008395:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000006a95bc51/0x4c16c38a9b6ce4c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.008401:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000006a95bc51/0x4c16c38a9b6ce4c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.008409:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000006a95bc51/0x4c16c38a9b6ce4c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.008422:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000696bf73e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945024:0@lo:101: 00000100:00100000:2.0:1788869323.008454:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.008483:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000797a430f going to sleep for 11 seconds 00000100:00100000:1.0:1788869323.008532:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324945024 00000100:00100000:1.0:1788869323.008537:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324945024 00000100:00100000:1.0:1788869323.008574:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869323.008581:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000333282ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:7454:x1875765324945024:12345-0@lo:101: 00010000:00010000:1.0:1788869323.008819:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869323.008830:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5cb6f31/0x4c16c38a9b6ce4d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce4c9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.008848:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5cb6f31/0x4c16c38a9b6ce4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce4c9 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.008855:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5cb6f31/0x4c16c38a9b6ce4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce4c9 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.008861:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5cb6f31, rc 0) 00000100:00100000:1.0:1788869323.008899:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000333282ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324945024:12345-0@lo:101: Request processed in 319us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869323.008905:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869323.008972:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000696bf73e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945024:0@lo:101: 00010000:00010000:2.0:1788869323.008983:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000006a95bc51/0x4c16c38a9b6ce4c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.009000:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000006a95bc51/0x4c16c38a9b6ce4c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.009087:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000696bf73e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945152:0@lo:501: 00000100:00100000:2.0:1788869323.009114:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.009176:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000797a430f going to sleep for 11 seconds 00000100:00100000:0.0:1788869323.009271:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324945152 00000100:00100000:0.0:1788869323.009276:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324945152 00000100:00100000:0.0:1788869323.009348:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869323.009355:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8f27c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324945152:12345-0@lo:501: 00000100:00100000:0.0:1788869323.009471:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8f27c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324945152:12345-0@lo:501: Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869323.009477:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869323.009623:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000696bf73e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945152:0@lo:501: 00000100:00100000:1.0:1788869323.009654:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d01d9392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945280:0@lo:503: 00000100:00100000:1.0:1788869323.009697:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869323.010047:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab68ec2 going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.010167:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324945280 00000100:00100000:2.0:1788869323.010173:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324945280 00000100:00100000:2.0:1788869323.010199:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788869323.010206:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031625e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324945280:12345-0@lo:503: 00000100:00100000:2.0:1788869323.010306:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031625e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324945280:12345-0@lo:503: Request processed in 100us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.010313:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869323.010400:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d01d9392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945280:0@lo:503: 00000040:00080000:1.0:1788869323.010698:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788869323.010788:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d01d9392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945408:0@lo:502: 00000100:00100000:1.0:1788869323.010825:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869323.010844:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab68ec2 going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.011007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324945408 00000100:00100000:2.0:1788869323.011013:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324945408 00000100:00100000:2.0:1788869323.011037:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788869323.011044:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f4fa361d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324945408:12345-0@lo:502: 00000100:00100000:2.0:1788869323.011119:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f4fa361d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324945408:12345-0@lo:502: Request processed in 76us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.011125:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869323.011271:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d01d9392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945408:0@lo:502: 00000040:00080000:1.0:1788869323.011469:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788869323.011499:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788869323.011516:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788869323.011530:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788869323.011542:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788869323.011555:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788869323.011568:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788869323.011581:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788869323.011634:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788869323.011650:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788869323.011664:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788869323.011678:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788869323.011691:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788869323.011704:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788869323.011717:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788869323.011730:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788869323.011831:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788869323.011850:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788869323.011866:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788869323.011879:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788869323.011893:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788869323.011907:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788869323.011945:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788869323.011975:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d01d9392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945536:0@lo:502: 00000100:00100000:1.0:1788869323.012105:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869323.012138:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab68ec2 going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.012241:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324945536 00000100:00100000:2.0:1788869323.012248:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324945536 00000100:00100000:2.0:1788869323.012277:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869323.012283:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002bd851f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324945536:12345-0@lo:502: 00000100:00100000:2.0:1788869323.012366:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002bd851f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324945536:12345-0@lo:502: Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.012373:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869323.012461:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d01d9392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324945536:0@lo:502: 00000040:00080000:1.0:1788869323.012506:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788869323.012513:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788869323.013085:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869323.013098:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869323.013100:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788869323.013105:0:7466:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788869323.013108:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869323.013133:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000083225eb1) 00000020:00000080:1.0:1788869323.013155:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788869323.013172:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788869323.013249:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788869323.013256:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6ce4de 00000020:00000080:1.0:1788869323.013487:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788869323.013492:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869323.013496:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869323.013497:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788869323.013499:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869323.013503:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869323.013505:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788869323.013508:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869323.013515:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000016db821) 00000020:00000080:1.0:1788869323.013526:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788869323.013531:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788869323.013532:0:7466:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788869323.013535:0:7466:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788869323.013541:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788869323.013638:0:7466:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001a2d9828 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788869323.013651:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000f5e1a324) 00000020:00000080:1.0:1788869323.013659:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788869323.013734:0:7466:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788869323.015856:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6ce4f3 00000020:00000080:1.0:1788869323.016915:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788869323.016932:0:7466:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788869323.016941:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4c16c38a9b6ce4fa 00080000:01000000:1.0:1788869323.016951:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788869323.016955:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6ce501 00080000:10000000:1.0:1788869323.017515:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788869323.017706:0:7466:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788869323.113715:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788869323.114475:0:7466:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1788869323.117975:0:7466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788869323.120290:0:7466:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788869323.135062:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788869323.135075:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869323.135091:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869323.135094:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788869323.135097:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869323.135104:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869323.135105:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788869323.135108:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788869323.135114:0:7466:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:00000080:0.0:1788869323.135145:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869323.135185:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000053c0fd9e) 00000020:00000080:0.0:1788869323.135208:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788869323.135216:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788869323.135345:0:7466:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788869323.135351:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788869323.135358:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6ce50f 00010000:00080000:0.0:1788869323.135395:0:7466:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000030d9bc60@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1788869323.140395:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788869323.145542:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788869323.145559:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788869323.145618:0:7466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788869323.145640:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6ce516 00000100:00080000:0.0:1788869323.145651:0:7466:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869323.145663:0:7466:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000030d9bc60 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869323.145706:0:7466:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b2fe46c0 x1875765324945664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869323.146033:0:7466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788869323.146198:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2fe46c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765324945664:0@lo:38: 00000100:00100000:0.0:1788869323.146253:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019877b1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324945792:0@lo:400: 00000100:00100000:0.0:1788869323.146298:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.146314:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.146443:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324945792 00000100:00100000:3.0:1788869323.146452:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324945792 00000100:00100000:3.0:1788869323.146498:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869323.146506:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008e36d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:3651:x1875765324945792:12345-0@lo:400: 00000100:00100000:3.0:1788869323.146559:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008e36d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:3651:x1875765324945792:12345-0@lo:400: Request processed in 54us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869323.146567:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869323.146644:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324945664 00000100:00100000:3.0:1788869323.146648:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324945664 00000100:00100000:3.0:1788869323.146666:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869323.146670:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2af7265 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765324945664:12345-0@lo:38: 00010000:00080000:3.0:1788869323.146690:0:6529:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788869323.146723:0:6529:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6ce51d 00000004:00100000:3.0:1788869323.146752:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788869323.146758:0:6529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788869323.147144:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019877b1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324945792:0@lo:400: 00000100:00100000:0.0:1788869323.147189:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005148e5d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324945920:0@lo:400: 00000100:00100000:0.0:1788869323.147226:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788869323.147326:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869323.147331:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869323.147333:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788869323.147335:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788869323.147339:0:7466:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788869323.147341:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869323.147342:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869323.147344:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788869323.147346:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869323.147347:0:7466:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788869323.147350:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869323.147354:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869323.147356:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788869323.147360:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788869323.147403:0:7466:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788869323.147416:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869323.147419:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869323.147420:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788869323.147422:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869323.147425:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869323.147426:0:7466:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869323.147429:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869323.147443:0:7466:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869323.147473:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869323.147476:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869323.147478:0:7466:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788869323.147480:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1788869323.147686:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788869323.147720:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788869323.147754:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000006a95bc51/0x4c16c38a9b6ce4c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.147767:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000006a95bc51/0x4c16c38a9b6ce4c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869323.147775:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e282daf5000 from 1 10000000:01000000:3.0:1788869323.147779:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869323.147806:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.147824:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.147833:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869323.147849:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c4631e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946048:0@lo:101: 00000100:00100000:3.0:1788869323.147884:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.147906:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034506c98 going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.148249:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324945920 00000100:00100000:2.0:1788869323.148257:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324945920 00000100:00100000:2.0:1788869323.148311:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869323.148321:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019877b1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324945920:12345-0@lo:400: 00000100:00100000:2.0:1788869323.148383:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019877b1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324945920:12345-0@lo:400: Request processed in 64us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.148390:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869323.148413:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324946048 00000100:00100000:2.0:1788869323.148417:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324946048 00000100:00100000:2.0:1788869323.148439:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869323.148445:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000021970011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+12:7454:x1875765324946048:12345-0@lo:101: 00010000:00010000:2.0:1788869323.148453:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869323.148464:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce524 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.148488:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce524 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.148498:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce524 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.148505:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d90752c, rc 0) 00000100:00100000:2.0:1788869323.148546:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000021970011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:7454:x1875765324946048:12345-0@lo:101: Request processed in 103us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.148559:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788869323.148632:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005148e5d4 x1875765324945920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869323.148646:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005148e5d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324945920:0@lo:400: 00000100:00100000:2.0:1788869323.148677:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c4631e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946048:0@lo:101: 00010000:00010000:2.0:1788869323.148689:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.148696:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.151701:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946176:0@lo:256: 00000100:00100000:2.0:1788869323.151793:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.151842:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000080885f7b going to sleep for 11 seconds 00000100:00100000:0.0:1788869323.153230:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324946176 00000100:00100000:0.0:1788869323.153246:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324946176 00000100:00100000:0.0:1788869323.153310:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869323.153319:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009817189c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:7454:x1875765324946176:12345-0@lo:256: 20000000:01000000:0.0:1788869323.153345:0:6519:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788869323.153370:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788869323.153373:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788869323.153515:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009817189c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:7454:x1875765324946176:12345-0@lo:256: Request processed in 198us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869323.153524:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869323.154933:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946176:0@lo:256: 10000000:01000000:2.0:1788869323.155581:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869323.155641:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.155655:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869323.155663:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282daf5000 from 1 10000000:01000000:2.0:1788869323.155666:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869323.155706:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.155731:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.155742:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.155766:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946304:0@lo:101: 00000100:00100000:2.0:1788869323.155832:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.155866:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000080885f7b going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.155897:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324946304 00000100:00100000:2.0:1788869323.155904:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324946304 00000100:00100000:2.0:1788869323.155955:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869323.155964:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000588c25de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:7454:x1875765324946304:12345-0@lo:101: 00010000:00010000:2.0:1788869323.155977:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869323.155991:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce532 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.156018:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce532 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.156028:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce532 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.156036:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000344ebfa, rc 0) 00000100:00100000:2.0:1788869323.156073:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000588c25de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:7454:x1875765324946304:12345-0@lo:101: Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.156079:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869323.156126:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946304:0@lo:101: 00010000:00010000:2.0:1788869323.156147:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869323.156167:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869323.156264:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946432:0@lo:501: 00000100:00100000:2.0:1788869323.156290:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.156306:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000001dcf8a9 going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.156321:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324946432 00000100:00100000:2.0:1788869323.156324:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324946432 00000100:00100000:2.0:1788869323.156345:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869323.156351:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000929fa1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:7454:x1875765324946432:12345-0@lo:501: 00000100:00100000:2.0:1788869323.156471:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000929fa1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:7454:x1875765324946432:12345-0@lo:501: Request processed in 119us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.156479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869323.156514:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946432:0@lo:501: 00000100:00100000:2.0:1788869323.156544:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946560:0@lo:503: 00000100:00100000:2.0:1788869323.156611:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.156635:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000001dcf8a9 going to sleep for 11 seconds 00000100:00100000:3.0:1788869323.157432:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324946560 00000100:00100000:3.0:1788869323.157443:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324946560 00000100:00100000:3.0:1788869323.157484:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869323.157491:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb28c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:7454:x1875765324946560:12345-0@lo:503: 00000040:00080000:3.0:1788869323.157542:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869323.157632:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb28c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:7454:x1875765324946560:12345-0@lo:503: Request processed in 141us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869323.157639:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869323.157702:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946560:0@lo:503: 00000040:00080000:0.0:1788869323.158206:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869323.158255:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788869323.158328:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869323.161935:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1788869323.162121:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788869323.162163:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869323.162179:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.162194:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869323.162247:0:7454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788869323.162250:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e282daf5000 10000000:01000000:1.0:1788869323.162252:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e282daf5000 10000000:01000000:1.0:1788869323.162258:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869323.162264:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e282daf5000 from 1 10000000:01000000:1.0:1788869323.162267:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869323.162306:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000453f3c81/0x4c16c38a9b6ce540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.162330:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000453f3c81/0x4c16c38a9b6ce540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.162342:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000453f3c81/0x4c16c38a9b6ce540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869323.162366:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d01d9392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946688:0@lo:101: 00000100:00100000:1.0:1788869323.162439:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869323.162485:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b68131f5 going to sleep for 11 seconds 00000100:00100000:3.0:1788869323.163232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324946688 00000100:00100000:3.0:1788869323.163245:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324946688 00000100:00100000:3.0:1788869323.163309:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869323.163319:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091518c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:7454:x1875765324946688:12345-0@lo:101: 00010000:00010000:3.0:1788869323.163335:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869323.163354:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9940ff1/0x4c16c38a9b6ce547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce540 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.163391:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9940ff1/0x4c16c38a9b6ce547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce540 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.163424:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9940ff1/0x4c16c38a9b6ce547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce540 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.163435:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9940ff1, rc 0) 00000100:00100000:3.0:1788869323.163514:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091518c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324946688:12345-0@lo:101: Request processed in 197us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869323.163521:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869323.163609:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d01d9392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946688:0@lo:101: 00010000:00010000:3.0:1788869323.163628:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000453f3c81/0x4c16c38a9b6ce540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.163637:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000453f3c81/0x4c16c38a9b6ce540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869323.163782:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000269e18e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946816:0@lo:501: 00000100:00100000:3.0:1788869323.163815:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.163843:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ac716bd9 going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.164205:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324946816 00000100:00100000:2.0:1788869323.164212:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324946816 00000100:00100000:2.0:1788869323.164252:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869323.164259:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b231c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324946816:12345-0@lo:501: 00000100:00100000:2.0:1788869323.164369:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b231c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324946816:12345-0@lo:501: Request processed in 111us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.164377:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869323.164421:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000269e18e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946816:0@lo:501: 00000100:00100000:2.0:1788869323.164451:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fb14900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946944:0@lo:503: 00000100:00100000:2.0:1788869323.164492:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.164513:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324946944 00000100:00100000:2.0:1788869323.164516:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324946944 00000100:00100000:2.0:1788869323.164531:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869323.164536:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051ac17a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324946944:12345-0@lo:503: 00000100:00100000:2.0:1788869323.164629:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051ac17a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324946944:12345-0@lo:503: Request processed in 92us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.164636:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869323.164675:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ba9484d going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.164687:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fb14900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324946944:0@lo:503: 00000040:00080000:2.0:1788869323.165267:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869323.165348:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fb14900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324947072:0@lo:502: 00000100:00100000:2.0:1788869323.165399:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.165433:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324947072 00000100:00100000:2.0:1788869323.165438:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324947072 00000100:00100000:2.0:1788869323.165472:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869323.165478:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f854989 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324947072:12345-0@lo:502: 00000100:00100000:2.0:1788869323.165571:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f854989 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324947072:12345-0@lo:502: Request processed in 92us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.165577:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869323.165639:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ba9484d going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.165653:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fb14900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324947072:0@lo:502: 00000040:00080000:2.0:1788869323.166343:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788869323.166384:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788869323.166405:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788869323.166417:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788869323.166430:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788869323.166441:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788869323.166454:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788869323.166469:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788869323.166487:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788869323.166500:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788869323.166513:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788869323.166526:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788869323.166540:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788869323.166553:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788869323.166567:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788869323.166581:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788869323.166630:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788869323.166642:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788869323.166653:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788869323.166666:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788869323.166677:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788869323.166688:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788869323.166701:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788869323.166714:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788869323.166726:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788869323.167109:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788869323.167129:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788869323.167142:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788869323.167190:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fb14900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324947200:0@lo:502: 00000100:00100000:2.0:1788869323.167261:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.167303:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324947200 00000100:00100000:2.0:1788869323.167312:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324947200 00000100:00100000:2.0:1788869323.167369:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869323.167376:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d8e7b11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324947200:12345-0@lo:502: 00000100:00100000:2.0:1788869323.167479:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d8e7b11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324947200:12345-0@lo:502: Request processed in 104us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.167487:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869323.167539:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ba9484d going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.167559:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fb14900 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324947200:0@lo:502: 00000040:00080000:2.0:1788869323.167630:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788869323.167637:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788869323.170377:0:7472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788869323.170400:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000084d5af33) 00000020:00000080:1.0:1788869323.170431:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788869323.170528:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001a2d9828 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788869323.170532:0:7472:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001a2d9828 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788869323.170534:0:7472:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001a2d9828 3 00010000:00080000:1.0:1788869323.170562:0:7472:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003b827f67@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.154@tcp at head 00000100:00080000:0.0:1788869323.172548:0:6529:0:(import.c:65:import_set_state_nolock()) 0000000002352ccd : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869323.172690:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2af7265 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765324945664:12345-0@lo:38: Request processed in 26016us (26375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869323.172707:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869323.172965:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869323.172979:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788869323.173002:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788869323.173008:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788869323.173010:0:3647:0:(import.c:65:import_set_state_nolock()) 0000000030d9bc60 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788869323.173022:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2fe46c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765324945664:0@lo:38: 00000100:00100000:1.0:1788869323.173315:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bb677d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324947328:0@lo:41: 00000100:00100000:1.0:1788869323.173378:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869323.173486:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324947328 00000100:00100000:0.0:1788869323.173497:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324947328 00000100:00100000:0.0:1788869323.173551:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869323.173559:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000882dd73e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875765324947328:12345-0@lo:41: 00000004:00000024:0.0:1788869323.173610:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788869323.173663:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000882dd73e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875765324947328:12345-0@lo:41: Request processed in 105us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869323.173669:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869323.173706:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bb677d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324947328:0@lo:41: 00010000:00010000:2.0:1788869323.175221:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788869323.175440:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788869323.175487:0:7472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869323.175516:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4c16c38a9b6ce555 00000100:00080000:2.0:1788869323.175525:0:7472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869323.175536:0:7472:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000003b827f67 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869323.175574:0:7472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006fb14900 x1875765324947456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869323.175625:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fb14900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765324947456:0@lo:38: 00000100:00100000:2.0:1788869323.175689:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788869323.175881:0:7472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788869323.178262:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324947456 00000100:00100000:2.0:1788869323.178285:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324947456 00000100:00100000:2.0:1788869323.179242:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869323.179251:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f178f44c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765324947456:12345-0@lo:38: 00010000:00080000:2.0:1788869323.179285:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1788869323.179333:0:6525:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4c16c38a9b6ce55c 00000004:00100000:2.0:1788869323.179350:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869323.179391:0:6525:0:(import.c:65:import_set_state_nolock()) 000000003b2b2a0d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869323.179525:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f178f44c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765324947456:12345-0@lo:38: Request processed in 273us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.179534:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788869323.179653:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006fb14900 x1875765324947456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869323.179668:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869323.179677:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788869323.179685:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788869323.179690:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788869323.179693:0:3647:0:(import.c:65:import_set_state_nolock()) 000000003b827f67 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788869323.179699:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fb14900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765324947456:0@lo:38: 00000040:00080000:2.0:1788869323.182527:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1788869323.182725:0:7474:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1788869323.182955:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788869323.183071:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869323.183092:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000453f3c81/0x4c16c38a9b6ce540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.183107:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000453f3c81/0x4c16c38a9b6ce540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788869323.183209:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788869323.183212:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869323.183218:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869323.183220:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869323.183221:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869323.183222:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869323.183223:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869323.183225:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869323.183226:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869323.183227:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869323.183228:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869323.183232:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788869323.183234:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869323.183236:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869323.183236:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869323.183237:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869323.183238:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869323.183239:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869323.183239:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869323.183240:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869323.183241:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869323.183242:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869323.183243:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869323.183269:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788869323.183288:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008bc651da pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324947584:0@lo:253: 00000100:00100000:3.0:1788869323.183354:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.183404:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ac716bd9 going to sleep for 11 seconds 00000100:00100000:1.0:1788869323.183470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324947584 00000100:00100000:1.0:1788869323.183484:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324947584 00000100:00100000:1.0:1788869323.183536:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869323.183544:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058f3ffd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324947584:12345-0@lo:253: 20000000:01000000:1.0:1788869323.183569:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788869323.183583:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788869323.185655:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788869323.187112:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869323.187137:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788869323.187423:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788869323.187428:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788869323.187450:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.187469:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce47c expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.187477:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce524 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.187495:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.187534:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce524 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.187548:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce524 expref: 15 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869323.187562:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000595cf3d1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324947712:0@lo:104: 00000100:00100000:3.0:1788869323.187648:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869323.187697:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce47c expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.187704:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce47c expref: 15 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869323.187711:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036926e68 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324947840:0@lo:104: 00000100:00100000:3.0:1788869323.187744:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.187762:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c0a313a going to sleep for 11 seconds 00000100:00100000:3.0:1788869323.187790:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324947712 00000100:00100000:3.0:1788869323.187797:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324947712 00000100:00100000:3.0:1788869323.187832:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324947840 00000100:00100000:3.0:1788869323.187835:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324947840 00000100:00100000:3.0:1788869323.187848:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869323.187856:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073e670cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6540:x1875765324947712:12345-0@lo:104: 00010000:00010000:3.0:1788869323.187868:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.187930:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869323.187936:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073e670cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6540:x1875765324947712:12345-0@lo:104: Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869323.187942:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869323.187960:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869323.187966:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000807db403 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6540:x1875765324947840:12345-0@lo:104: 00010000:00010000:3.0:1788869323.187973:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.188917:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869323.188929:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000807db403 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6540:x1875765324947840:12345-0@lo:104: Request processed in 962us (1196us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869323.188936:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788869323.188941:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788869323.188946:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.188958:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee8b2e0f already unused, calling callback (000000008cf644ed) 10000000:00010000:1.0:1788869323.188961:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.188968:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869323.188971:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869323.188980:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869323.188987:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869323.189024:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.189030:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788869323.189274:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058f3ffd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7454:x1875765324947584:12345-0@lo:253: Request processed in 5731us (5919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.189283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869323.189338:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008bc651da pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7454:1875765324947584:0@lo:253: 10000000:01000000:2.0:1788869323.189353:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788869323.189357:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869323.189359:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869323.189361:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869323.189362:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869323.189363:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869323.189364:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869323.189366:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869323.189367:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869323.189368:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869323.189370:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869323.189371:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788869323.189393:0:7454:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788869323.189742:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.189750:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 00000000ee8b2e0f/0x4c16c38a9b6ce524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce52b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869323.189762:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000595cf3d1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324947712:0@lo:104: 00010000:00010000:1.0:1788869323.189763:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869323.189774:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036926e68 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324947840:0@lo:104: 00010000:00010000:1.0:1788869323.189777:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869323.189781:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869323.189795:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869323.191165:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053e88363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324947968:0@lo:103: 00000100:00100000:1.0:1788869323.191244:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.192344:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324947968 00000100:00100000:3.0:1788869323.192359:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324947968 00010000:00010000:3.0:1788869323.192396:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce524 expref: 15 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869323.192436:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869323.192445:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cedc2c4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:3650:x1875765324947968:12345-0@lo:103: 00010000:00010000:3.0:1788869323.192473:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869323.192478:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce524 expref: 15 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.192492:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce524 expref: 15 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.192509:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d90752c/0x4c16c38a9b6ce52b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce524 expref: 15 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.192522:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869323.192575:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cedc2c4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:3650:x1875765324947968:12345-0@lo:103: Request processed in 133us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869323.192582:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869323.192649:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053e88363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324947968:0@lo:103: 00010000:00010000:1.0:1788869323.193340:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869323.193345:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869323.193347:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869323.193495:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.193507:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008295f894 already unused, calling callback (000000008cf644ed) 10000000:00010000:3.0:1788869323.193510:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.193518:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869323.193525:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869323.193530:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869323.193581:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.193612:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869323.193631:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.193638:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000008295f894/0x4c16c38a9b6ce47c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce483 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869323.193656:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869323.193657:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869323.193658:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869323.193664:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869323.193677:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036926e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324948096:0@lo:103: 00000100:00100000:3.0:1788869323.194165:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869323.194252:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324948096 00000100:00100000:1.0:1788869323.194260:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324948096 00010000:00010000:1.0:1788869323.194285:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce47c expref: 14 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869323.194318:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869323.194327:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000925e0b08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:3650:x1875765324948096:12345-0@lo:103: 00010000:00010000:1.0:1788869323.194338:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869323.194342:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce47c expref: 14 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194353:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce47c expref: 14 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194364:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005e4028ee/0x4c16c38a9b6ce483 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce47c expref: 14 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194378:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194385:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788869323.194398:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012655653s 00010000:00010000:1.0:1788869323.194411:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194417:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194422:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194428:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194433:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a310777 already unused, calling callback (00000000c6f56d4a) 00010000:00010000:1.0:1788869323.194437:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194444:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194467:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869323.194478:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869323.194520:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000925e0b08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:3650:x1875765324948096:12345-0@lo:103: Request processed in 196us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869323.194527:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788869323.194872:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869323.194882:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869323.194888:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007a310777/0x4c16c38a9b6ce563 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869323.195120:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036926e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324948096:0@lo:103: 00080000:10000000:2.0:1788869323.198184:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788869323.198373:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788869323.198627:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788869323.198802:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788869323.199006:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788869323.200170:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788869323.201247:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788869323.201499:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788869323.205466:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788869323.205726:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788869323.206208:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788869323.206392:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788869323.208140:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788869323.208464:0:7479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788869323.208528:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036926e68 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875765324948224:0@lo:700: 00000100:00100000:3.0:1788869323.208618:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.208654:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c2a9424 going to sleep for 11 seconds 00000040:01000000:0.0:1788869323.208713:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788869323.209190:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324948224 00000100:00100000:1.0:1788869323.209199:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324948224 00000100:00100000:1.0:1788869323.209310:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869323.209319:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000595cf3d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7479:x1875765324948224:12345-0@lo:700: 00000020:00080000:2.0:1788869323.209933:0:7478:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788869323.209938:0:7478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788869323.210184:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c90431b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324948352:0@lo:1000: 00000100:00100000:0.0:1788869323.210245:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869323.210276:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 0000000004ea1c90 going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.210327:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324948352 00000100:00100000:2.0:1788869323.210338:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324948352 00000100:00100000:2.0:1788869323.210378:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869323.210384:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006bd7bf84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324948352:12345-0@lo:1000: 00000100:00100000:2.0:1788869323.210469:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006bd7bf84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324948352:12345-0@lo:1000: Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.210476:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869323.210554:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c90431b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324948352:0@lo:1000: 00000040:01000000:3.0:1788869323.210624:0:7480:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788869323.210653:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000777fc862 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324948480:0@lo:700: 00000100:00100000:3.0:1788869323.210680:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.210699:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013d41739 going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.210769:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324948480 00000100:00100000:2.0:1788869323.210774:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324948480 00000100:00100000:2.0:1788869323.210805:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869323.210811:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008bc651da pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324948480:12345-0@lo:700: 00000100:00100000:2.0:1788869323.210850:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008bc651da pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324948480:12345-0@lo:700: Request processed in 40us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.210857:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869323.211018:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000777fc862 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324948480:0@lo:700: 00000100:00100000:3.0:1788869323.211056:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000777fc862 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7480:1875765324948608:0@lo:900: 00000100:00100000:3.0:1788869323.211078:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.211100:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013d41739 going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.211216:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324948608 00000100:00100000:2.0:1788869323.211221:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324948608 00000100:00100000:2.0:1788869323.211252:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869323.211258:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006bb677d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7480:x1875765324948608:12345-0@lo:900: 00000100:00100000:2.0:1788869323.211293:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006bb677d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7480:x1875765324948608:12345-0@lo:900: Request processed in 37us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.211300:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788869323.211357:0:7480:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000777fc862 x1875765324948608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869339 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869323.211368:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000777fc862 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7480:1875765324948608:0@lo:900: 00000100:00100000:3.0:1788869323.211437:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000777fc862 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324948736:0@lo:1000: 00000100:00100000:3.0:1788869323.211467:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.211489:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a60d448d going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.211529:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324948736 00000100:00100000:2.0:1788869323.211533:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324948736 00000100:00100000:2.0:1788869323.211552:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869323.211556:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000269e18e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324948736:12345-0@lo:1000: 00000100:00100000:2.0:1788869323.211636:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000269e18e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324948736:12345-0@lo:1000: Request processed in 79us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.211642:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869323.212176:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000777fc862 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324948736:0@lo:1000: 00000004:00080000:3.0:1788869323.212225:0:7480:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000013d41739 with version 0 00000020:00100000:3.0:1788869323.212241:0:7480:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788869323.212247:0:7480:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000777fc862 x1875765324948992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869323.212259:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000777fc862 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324948992:0@lo:1000: 00000100:00100000:3.0:1788869323.212289:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.212311:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023bbb50a going to sleep for 11 seconds 00000100:00100000:2.0:1788869323.212352:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324948992 00000100:00100000:2.0:1788869323.212363:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324948992 00000100:00100000:2.0:1788869323.212387:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869323.212392:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c4631e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324948992:12345-0@lo:1000: 00000040:01000000:1.0:1788869323.213464:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788869323.213720:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788869323.214342:0:7454:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788869323.214352:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788869323.214530:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869323.216233:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788869323.217209:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788869323.217261:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788869323.217488:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788869323.217948:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788869323.219130:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788869323.219302:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000001:00080000:0.0:1788869323.220894:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:0.0:1788869323.220948:0:6531:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1788869323.221200:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c4631e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324948992:12345-0@lo:1000: Request processed in 8804us (8907us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788869323.221214:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788869323.221272:0:7480:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788869323.221277:0:7480:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788869323.221293:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000777fc862 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324948992:0@lo:1000: 00000100:00100000:2.0:1788869323.221396:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084829b56 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324949120:0@lo:1000: 00000100:00100000:2.0:1788869323.221434:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869323.221458:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0d88b67 going to sleep for 11 seconds 00100000:10000000:1.0:1788869323.222477:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788869323.222658:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788869323.226362:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788869323.226653:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788869323.227088:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788869323.227258:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788869323.227413:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788869323.227560:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788869323.228282:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788869323.228446:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788869323.230199:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788869323.230454:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000100:00100000:2.0:1788869323.230725:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324949120 00000100:00100000:2.0:1788869323.230856:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324949120 00000100:00100000:2.0:1788869323.230920:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869323.230929:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b6d5155 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324949120:12345-0@lo:1000: 00100000:10000000:1.0:1788869323.231904:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788869323.232298:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788869323.232651:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:2.0:1788869323.233137:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b6d5155 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875765324949120:12345-0@lo:1000: Request processed in 2201us (11695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869323.233151:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869323.234307:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000595cf3d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7479:x1875765324948224:12345-0@lo:700: Request processed in 24984us (25684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869323.234335:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:1.0:1788869323.234702:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788869323.234902:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788869323.235276:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788869323.235456:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788869323.235629:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788869323.236236:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788869323.236413:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788869323.236553:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000100:00100000:3.0:1788869323.236946:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084829b56 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875765324949120:0@lo:1000: 00000040:00080000:3.0:1788869323.236995:0:7480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788869323.237043:0:7480:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000bad6fbcf with version 1 00000004:00080000:3.0:1788869323.237067:0:7468:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a8f5e308 version 1 rpc_version 1 00000020:00100000:3.0:1788869323.237100:0:7468:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788869323.237108:0:7468:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004434de15 x1875765324949376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869323.237131:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1875765324949376:0@lo:1000: 00000100:00100000:3.0:1788869323.237208:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869323.237256:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 0000000087a4b5bc going to sleep for 11 seconds 00000100:00100000:3.0:1788869323.237278:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324949376 00000100:00100000:3.0:1788869323.237285:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324949376 00000100:00100000:3.0:1788869323.237330:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869323.237337:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000806f6141 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1875765324949376:12345-0@lo:1000: 00100000:10000000:1.0:1788869323.238966:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788869323.239388:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788869323.239609:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00010000:00080000:2.0:1788869323.241064:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000036926e68 x1875765324948224/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788869339 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869323.241088:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036926e68 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875765324948224:0@lo:700: 40000000:02000000:2.0:1788869323.241103:0:7479:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1788869323.243211:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000001:00080000:0.0:1788869323.243817:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788869323.243968:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000806f6141 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1875765324949376:12345-0@lo:1000: Request processed in 6627us (6757us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788869323.244869:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00100000:10000000:1.0:1788869323.246242:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788869323.246403:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788869323.246561:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000040:00080000:3.0:1788869323.247727:0:7480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000001:00000004:1.0:1788869323.247979:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:3.0:1788869323.248145:0:7480:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788869323.248228:0:7468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788869323.248233:0:7468:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788869323.248254:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1875765324949376:0@lo:1000: 00000001:00080000:1.0:1788869323.257851:0:7454:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788869323.257891:0:7454:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb9f681c7f988 00100000:10000000:1.0:1788869323.257900:0:7454:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788869323.258492:0:7454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788869323.258526:0:7454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788869323.258547:0:7454:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788869323.258562:0:7454:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788869323.262709:0:7454:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869323.262980:0:7454:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788869323.299030:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869323.306315:0:7479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788869323.306394:0:7479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788869323.306399:0:7479:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788869323.973850:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869325.002679:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869326.027666:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869327.052061:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869328.072322:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869328.198303:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cedc2c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324949504:0@lo:41: 00000100:00100000:1.0:1788869328.198399:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869328.198505:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324949504 00000100:00100000:1.0:1788869328.198514:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324949504 00000100:00100000:1.0:1788869328.198563:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869328.198571:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b62da242 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324949504:12345-0@lo:41: 00000004:00000024:1.0:1788869328.198630:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788869328.198680:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b62da242 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324949504:12345-0@lo:41: Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869328.198687:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869328.198740:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cedc2c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324949504:0@lo:41: 00000100:00100000:1.0:1788869328.202208:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e354c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765324949760:0@lo:400: 00000100:00100000:1.0:1788869328.202277:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869328.202376:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869328.202382:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad13e31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324949888:0@lo:400: 00000100:00100000:1.0:1788869328.202408:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869328.202456:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324949760 00000100:00100000:1.0:1788869328.202463:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324949760 00000100:00100000:1.0:1788869328.202513:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324949888 00000100:00100000:1.0:1788869328.202516:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324949888 00000100:00100000:1.0:1788869328.202534:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869328.202543:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005dd5320e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765324949760:12345-0@lo:400: 00000100:00100000:1.0:1788869328.202623:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005dd5320e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765324949760:12345-0@lo:400: Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869328.202630:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869328.202649:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869328.202654:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a5528c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324949888:12345-0@lo:400: 00000100:00100000:1.0:1788869328.202679:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a5528c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324949888:12345-0@lo:400: Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869328.203249:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cedc2c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324949632:0@lo:400: 00000100:00100000:0.0:1788869328.203297:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788869328.203392:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005ad13e31 x1875765324949888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869328.203406:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad13e31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324949888:0@lo:400: 00010000:00080000:0.0:1788869328.203415:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007e354c54 x1875765324949760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869328.203423:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e354c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765324949760:0@lo:400: 00000100:00100000:0.0:1788869328.203446:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324949632 00000100:00100000:0.0:1788869328.203450:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324949632 00000100:00100000:0.0:1788869328.203484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788869328.203490:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000364eb10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:3649:x1875765324949632:12345-0@lo:400: 00000100:00100000:0.0:1788869328.203524:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000364eb10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:3649:x1875765324949632:12345-0@lo:400: Request processed in 35us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869328.203530:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788869328.203558:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cedc2c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324949632:0@lo:400: 00000100:00100000:1.0:1788869328.204022:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:02000400:3.0:1788869328.261465:0:7725:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788869329.095263:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869329.342409:0:7777:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869329.342683:0:7777:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869330.125900:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869330.249036:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869330.249044:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e282daf5000 from 4 10000000:01000000:2.0:1788869330.249049:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869330.249095:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 0000000036133ecb/0x4c16c38a9b6ce56a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.249252:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 0000000036133ecb/0x4c16c38a9b6ce56a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.249265:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 0000000036133ecb/0x4c16c38a9b6ce56a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869330.249291:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a57b403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950016:0@lo:101: 00000100:00100000:2.0:1788869330.249364:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869330.249523:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000654567e6 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.253981:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324950016 00000100:00100000:1.0:1788869330.253997:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324950016 00000100:00100000:1.0:1788869330.254070:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788869330.254078:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000285393e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:6521:x1875765324950016:12345-0@lo:101: 00010000:00010000:1.0:1788869330.254096:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869330.254120:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce571 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce56a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254144:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce56a expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254153:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b225a37a/0x4c16c38a9b6ce571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce56a expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254161:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b225a37a, rc 0) 00000100:00100000:1.0:1788869330.254241:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000285393e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:6521:x1875765324950016:12345-0@lo:101: Request processed in 164us (4877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.254248:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788869330.254309:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a57b403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950016:0@lo:101: 00010000:00010000:1.0:1788869330.254328:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 0000000036133ecb/0x4c16c38a9b6ce56a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254336:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 0000000036133ecb/0x4c16c38a9b6ce56a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869330.254408:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950144:0@lo:256: 00000100:00100000:1.0:1788869330.254453:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.254482:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6f45e45 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.254510:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324950144 00000100:00100000:1.0:1788869330.254514:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324950144 00000100:00100000:1.0:1788869330.254538:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788869330.254544:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b5a8a58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:6521:x1875765324950144:12345-0@lo:256: 20000000:01000000:1.0:1788869330.254558:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788869330.254574:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788869330.254577:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788869330.254689:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b5a8a58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:6521:x1875765324950144:12345-0@lo:256: Request processed in 145us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.254696:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788869330.254736:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950144:0@lo:256: 10000000:01000000:1.0:1788869330.254788:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869330.254795:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 0000000036133ecb/0x4c16c38a9b6ce56a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254803:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 0000000036133ecb/0x4c16c38a9b6ce56a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869330.254812:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788869330.254814:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e281757b800 from 21 10000000:01000000:1.0:1788869330.254817:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869330.254836:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000005e4028ee/0x4c16c38a9b6ce578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254843:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000005e4028ee/0x4c16c38a9b6ce578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254859:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000005e4028ee/0x4c16c38a9b6ce578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869330.254871:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950272:0@lo:101: 00000100:00100000:1.0:1788869330.254896:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.254915:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6f45e45 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.254926:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324950272 00000100:00100000:1.0:1788869330.254930:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324950272 00000100:00100000:1.0:1788869330.254951:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869330.254956:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002fdfdd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:6521:x1875765324950272:12345-0@lo:101: 00010000:00010000:1.0:1788869330.254963:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869330.254971:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aaa714dc/0x4c16c38a9b6ce57f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce578 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254984:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aaa714dc/0x4c16c38a9b6ce57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce578 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254992:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aaa714dc/0x4c16c38a9b6ce57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce578 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.254998:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aaa714dc, rc 0) 00000100:00100000:1.0:1788869330.255035:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002fdfdd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324950272:12345-0@lo:101: Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.255041:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869330.255069:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950272:0@lo:101: 00010000:00010000:1.0:1788869330.255078:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000005e4028ee/0x4c16c38a9b6ce578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.255095:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000005e4028ee/0x4c16c38a9b6ce578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869330.255147:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950400:0@lo:501: 00000100:00100000:1.0:1788869330.255171:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.255184:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6f45e45 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.255194:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324950400 00000100:00100000:1.0:1788869330.255198:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324950400 00000100:00100000:1.0:1788869330.255218:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869330.255223:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b60f739f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324950400:12345-0@lo:501: 00000100:00100000:1.0:1788869330.255349:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b60f739f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324950400:12345-0@lo:501: Request processed in 125us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.255358:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869330.255389:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950400:0@lo:501: 00000100:00100000:1.0:1788869330.255416:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950528:0@lo:503: 00000100:00100000:1.0:1788869330.255453:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.255465:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6f45e45 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.255476:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324950528 00000100:00100000:1.0:1788869330.255480:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324950528 00000100:00100000:1.0:1788869330.255497:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869330.255501:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c235c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324950528:12345-0@lo:503: 00000100:00100000:1.0:1788869330.255564:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c235c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324950528:12345-0@lo:503: Request processed in 63us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.255570:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869330.255626:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950528:0@lo:503: 00000100:00100000:1.0:1788869330.255788:0:7825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7825:1875765324950656:0@lo:502: 00000100:00100000:1.0:1788869330.255816:0:7825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.255832:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324950656 00000100:00100000:1.0:1788869330.255835:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324950656 00000100:00100000:1.0:1788869330.255851:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869330.255855:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ef802fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7825:x1875765324950656:12345-0@lo:502: 00000100:00100000:1.0:1788869330.255920:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ef802fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7825:x1875765324950656:12345-0@lo:502: Request processed in 64us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.255926:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869330.255954:0:7825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000476943f1 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.255963:0:7825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7825:1875765324950656:0@lo:502: 00000100:00100000:1.0:1788869330.255994:0:7825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7825:1875765324950784:0@lo:502: 00000100:00100000:1.0:1788869330.256019:0:7825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.256048:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324950784 00000100:00100000:1.0:1788869330.256052:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324950784 00000100:00100000:1.0:1788869330.256070:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869330.256075:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f07ea2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7825:x1875765324950784:12345-0@lo:502: 00000100:00100000:1.0:1788869330.256129:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f07ea2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:7825:x1875765324950784:12345-0@lo:502: Request processed in 54us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.256135:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869330.256160:0:7825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000476943f1 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.256170:0:7825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7825:1875765324950784:0@lo:502: 00000040:00080000:1.0:1788869330.256186:0:7825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788869330.256234:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788869330.256252:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869330.256257:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000005e4028ee/0x4c16c38a9b6ce578 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.256272:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000005e4028ee/0x4c16c38a9b6ce578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869330.256280:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788869330.256282:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e281757b800 from 4 10000000:01000000:1.0:1788869330.256285:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788869330.256308:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 0000000082420695/0x4c16c38a9b6ce586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.256315:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 0000000082420695/0x4c16c38a9b6ce586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.256323:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 0000000082420695/0x4c16c38a9b6ce586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869330.256333:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950912:0@lo:101: 00000100:00100000:1.0:1788869330.256357:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.256370:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000476943f1 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.256381:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324950912 00000100:00100000:1.0:1788869330.256384:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324950912 00000100:00100000:1.0:1788869330.256403:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869330.256408:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000668b8502 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324950912:12345-0@lo:101: 00010000:00010000:1.0:1788869330.256415:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869330.256424:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d98b39d/0x4c16c38a9b6ce58d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce586 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.256438:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d98b39d/0x4c16c38a9b6ce58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce586 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.256456:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d98b39d/0x4c16c38a9b6ce58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce586 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.256462:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d98b39d, rc 0) 00000100:00100000:1.0:1788869330.256488:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000668b8502 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324950912:12345-0@lo:101: Request processed in 81us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.256493:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869330.256517:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324950912:0@lo:101: 00010000:00010000:1.0:1788869330.256526:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 0000000082420695/0x4c16c38a9b6ce586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.256533:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 0000000082420695/0x4c16c38a9b6ce586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869330.256564:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324951040:0@lo:256: 00000100:00100000:1.0:1788869330.256613:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.256630:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000476943f1 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.256641:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324951040 00000100:00100000:1.0:1788869330.256644:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324951040 00000100:00100000:1.0:1788869330.256662:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869330.256667:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a10822d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324951040:12345-0@lo:256: 20000000:01000000:1.0:1788869330.256678:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788869330.256693:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788869330.256696:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788869330.256753:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a10822d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324951040:12345-0@lo:256: Request processed in 86us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.256759:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869330.256790:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324951040:0@lo:256: 10000000:01000000:1.0:1788869330.256824:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869330.256828:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 0000000082420695/0x4c16c38a9b6ce586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.258194:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 0000000082420695/0x4c16c38a9b6ce586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869330.258208:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788869330.258210:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788869330.258213:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869330.258246:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 0000000043a105ce/0x4c16c38a9b6ce594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.258254:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 0000000043a105ce/0x4c16c38a9b6ce594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.258262:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 0000000043a105ce/0x4c16c38a9b6ce594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869330.258279:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324951168:0@lo:101: 00000100:00100000:1.0:1788869330.258329:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.258398:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c8c37a6f going to sleep for 11 seconds 00000100:00100000:0.0:1788869330.259999:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324951168 00000100:00100000:0.0:1788869330.260018:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324951168 00000100:00100000:1.0:1788869330.260277:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788869330.260290:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee5d4556 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324951168:12345-0@lo:101: 00010000:00010000:1.0:1788869330.260310:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869330.260331:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095b0c73d/0x4c16c38a9b6ce59b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce594 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.260388:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095b0c73d/0x4c16c38a9b6ce59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce594 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.260400:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095b0c73d/0x4c16c38a9b6ce59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce594 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869330.260409:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095b0c73d, rc 0) 00000100:00100000:3.0:1788869330.260745:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324951168:0@lo:101: 00010000:00010000:3.0:1788869330.260766:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 0000000043a105ce/0x4c16c38a9b6ce594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869330.260993:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 0000000043a105ce/0x4c16c38a9b6ce594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869330.261094:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324951296:0@lo:501: 00000100:00100000:3.0:1788869330.261717:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.261757:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053909558 going to sleep for 11 seconds 00000100:00100000:0.0:1788869330.262009:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324951296 00000100:00100000:0.0:1788869330.262018:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324951296 00000100:00100000:0.0:1788869330.262060:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788869330.262066:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000518f003e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324951296:12345-0@lo:501: 00000100:00100000:0.0:1788869330.262450:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000518f003e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324951296:12345-0@lo:501: Request processed in 383us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869330.262458:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788869330.263441:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee5d4556 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324951168:12345-0@lo:101: Request processed in 209us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869330.263450:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869330.270087:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324951296:0@lo:501: 00000100:00100000:3.0:1788869330.270365:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324951424:0@lo:503: 00000100:00100000:3.0:1788869330.270451:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.270514:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053909558 going to sleep for 11 seconds 00000100:00100000:2.0:1788869330.272297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324951424 00000100:00100000:2.0:1788869330.272316:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324951424 00000100:00100000:2.0:1788869330.272381:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788869330.272391:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008d4a28a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324951424:12345-0@lo:503: 00000100:00100000:2.0:1788869330.272568:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008d4a28a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324951424:12345-0@lo:503: Request processed in 178us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869330.272576:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788869330.273013:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324951424:0@lo:503: 00000100:00100000:3.0:1788869330.273272:0:7828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7828:1875765324951552:0@lo:502: 00000100:00100000:3.0:1788869330.273330:0:7828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869330.278305:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324951552 00000100:00100000:2.0:1788869330.278318:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324951552 00000100:00100000:3.0:1788869330.278455:0:7828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dce21f2d going to sleep for 11 seconds 00000100:00100000:2.0:1788869330.278535:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869330.278545:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004dc8fdd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:7828:x1875765324951552:12345-0@lo:502: 00000100:00100000:2.0:1788869330.281018:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004dc8fdd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:7828:x1875765324951552:12345-0@lo:502: Request processed in 2468us (7680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869330.281046:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869330.281772:0:7828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004434de15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7828:1875765324951552:0@lo:502: 00000020:01000000:3.0:1788869330.281963:0:7828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869330.281977:0:7828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869330.281980:0:7828:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788869330.281992:0:7828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869330.281997:0:7828:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:00000080:3.0:1788869330.282036:0:7828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869330.282055:0:7828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000203e0b2e) 00000020:00000080:3.0:1788869330.282079:0:7828:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788869330.282086:0:7828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869330.282338:0:7828:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788869330.282345:0:7828:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788869330.282354:0:7828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6ce5a9 00010000:00080000:3.0:1788869330.282391:0:7828:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000007b3e0c@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788869330.291432:0:7828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788869330.296403:0:7828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869330.296420:0:7828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788869330.296461:0:7828:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788869330.296484:0:7828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6ce5b0 00000100:00080000:2.0:1788869330.296508:0:7828:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869330.296520:0:7828:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000007b3e0c using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869330.296559:0:7828:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002a57b403 x1875765324951680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869330.296916:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a57b403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765324951680:0@lo:38: 00000100:00100000:3.0:1788869330.297062:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.297414:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324951680 00000100:00100000:1.0:1788869330.297423:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324951680 00000100:00100000:1.0:1788869330.297462:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869330.297468:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004434de15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765324951680:12345-0@lo:38: 00010000:00080000:1.0:1788869330.297504:0:6529:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:1.0:1788869330.297540:0:6529:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6ce5b7 00000004:00100000:1.0:1788869330.297558:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788869330.297567:0:6529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788869330.298033:0:7828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788869330.298086:0:7828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788869330.298278:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324951936:0@lo:400: 00000100:00100000:3.0:1788869330.298328:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.298355:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869330.298361:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000016d342d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324951808:0@lo:400: 00000100:00100000:3.0:1788869330.298388:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.298411:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869330.298419:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2164c17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324952064:0@lo:400: 00000100:00100000:3.0:1788869330.298442:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.298465:0:6530:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788869330.298473:0:6530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788869330.299279:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324951808 00000100:00100000:0.0:1788869330.299287:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324951808 00000100:00100000:0.0:1788869330.299327:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324952064 00000100:00100000:0.0:1788869330.299329:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324952064 00000100:00100000:0.0:1788869330.299342:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869330.299348:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036926e68 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324951808:12345-0@lo:400: 00000100:00100000:0.0:1788869330.299409:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036926e68 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324951808:12345-0@lo:400: Request processed in 61us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869330.299417:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869330.299431:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869330.299436:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000777fc862 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324952064:12345-0@lo:400: 00000100:00100000:0.0:1788869330.299463:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000777fc862 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324952064:12345-0@lo:400: Request processed in 28us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869330.299469:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788869330.299505:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000016d342d x1875765324951808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869330.299519:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000016d342d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324951808:0@lo:400: 00010000:00080000:0.0:1788869330.299560:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b2164c17 x1875765324952064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869330.299569:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2164c17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324952064:0@lo:400: 00000100:00100000:3.0:1788869330.301332:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324951936 00000100:00100000:3.0:1788869330.301346:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324951936 00000100:00100000:3.0:1788869330.301494:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869330.301504:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000061cf5c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324951936:12345-0@lo:400: 00000100:00100000:3.0:1788869330.301613:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000061cf5c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324951936:12345-0@lo:400: Request processed in 111us (3285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869330.301621:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869330.301665:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324951936:0@lo:400: 00000100:00080000:2.0:1788869330.303403:0:7832:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000084829b56 x1875765324952192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869330.303419:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c2d3e3b going to sleep for 0 seconds 00000020:01000000:3.0:1788869330.304215:0:7828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869330.304227:0:7828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869330.304229:0:7828:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788869330.304233:0:7828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869330.304237:0:7828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869330.304238:0:7828:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869330.304241:0:7828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869330.304243:0:7828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788869330.304275:0:7828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7828:1875765324952320:0@lo:502: 00000100:00100000:3.0:1788869330.304351:0:7828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.304393:0:7828:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b9eba33 going to sleep for 11 seconds 00000100:00100000:2.0:1788869330.304686:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324952320 00000100:00100000:2.0:1788869330.304693:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324952320 00000100:00100000:2.0:1788869330.305053:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869330.305063:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d199c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:7828:x1875765324952320:12345-0@lo:502: 00000100:00100000:2.0:1788869330.306323:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d199c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:7828:x1875765324952320:12345-0@lo:502: Request processed in 1258us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869330.306335:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788869330.306704:0:7828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:7828:1875765324952320:0@lo:502: 00000020:01000000:3.0:1788869330.307193:0:7828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869330.307202:0:7828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869330.307205:0:7828:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788869330.307211:0:7828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788869330.308186:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788869330.308221:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788869330.308901:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 0000000043a105ce/0x4c16c38a9b6ce594 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.308917:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 0000000043a105ce/0x4c16c38a9b6ce594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869330.309197:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788869330.309199:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e282a933380 from 1 10000000:01000000:2.0:1788869330.309202:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788869330.309236:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce5be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.309244:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce5be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.309254:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce5be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869330.309276:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6237ebb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324952448:0@lo:101: 00000100:00100000:2.0:1788869330.309342:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869330.309380:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044e5ebf6 going to sleep for 11 seconds 00000100:00100000:2.0:1788869330.311106:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324952448 00000100:00100000:2.0:1788869330.311581:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324952448 00000100:00100000:2.0:1788869330.311705:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788869330.311712:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c323d0f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324952448:12345-0@lo:101: 00010000:00010000:2.0:1788869330.311739:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869330.311755:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004b2327c2/0x4c16c38a9b6ce5c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce5be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.312491:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b2327c2/0x4c16c38a9b6ce5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce5be expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.312566:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004b2327c2/0x4c16c38a9b6ce5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce5be expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.318047:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004b2327c2, rc 0) 00000100:00100000:2.0:1788869330.318150:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c323d0f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324952448:12345-0@lo:101: Request processed in 6434us (8805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869330.318160:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788869330.318240:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6237ebb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324952448:0@lo:101: 00010000:00010000:2.0:1788869330.318263:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce5be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.318275:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce5be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869330.318357:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6237ebb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324952576:0@lo:501: 00000100:00100000:2.0:1788869330.318387:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869330.318418:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044e5ebf6 going to sleep for 11 seconds 00000100:00100000:2.0:1788869330.318436:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324952576 00000100:00100000:2.0:1788869330.318443:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324952576 00000100:00100000:2.0:1788869330.318474:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869330.318482:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000075001c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324952576:12345-0@lo:501: 00000100:00100000:2.0:1788869330.318569:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000075001c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324952576:12345-0@lo:501: Request processed in 88us (181us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869330.318576:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869330.318632:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6237ebb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324952576:0@lo:501: 10000000:01000000:2.0:1788869330.318659:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788869330.318664:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce5be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869330.318690:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000007d90752c/0x4c16c38a9b6ce5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788869330.329294:0:6529:0:(import.c:65:import_set_state_nolock()) 0000000040d75a2d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869330.329397:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004434de15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765324951680:12345-0@lo:38: Request processed in 31927us (32335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869330.329410:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869330.329794:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869330.329805:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788869330.329815:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788869330.329821:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788869330.329823:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000007b3e0c lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788869330.329845:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007c2d3e3b): req@0000000084829b56 x1875765324952192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869330.329859:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a57b403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765324951680:0@lo:38: 00000100:00100000:2.0:1788869330.330239:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869330.330276:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c2d3e3b going to sleep for 11 seconds 00000100:00100000:0.0:1788869330.330469:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869330.330481:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6237ebb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324952704:0@lo:41: 00000100:00100000:0.0:1788869330.330526:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.330770:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324952192 00000100:00100000:3.0:1788869330.330789:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324952192 00000100:00100000:3.0:1788869330.330827:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324952704 00000100:00100000:3.0:1788869330.330830:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324952704 00000100:00100000:3.0:1788869330.330848:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869330.330855:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0d13bdf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7832:x1875765324952192:12345-0@lo:1000: 00000100:00100000:3.0:1788869330.331134:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0d13bdf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7832:x1875765324952192:12345-0@lo:1000: Request processed in 279us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869330.331141:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869330.331158:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869330.331164:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009424c18d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765324952704:12345-0@lo:41: 00000004:00000024:3.0:1788869330.331185:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788869330.331271:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009424c18d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765324952704:12345-0@lo:41: Request processed in 108us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869330.331293:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869330.331332:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084829b56 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324952192:0@lo:1000: 00000040:01000000:3.0:1788869330.331365:0:7832:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788869330.331399:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324952832:0@lo:1000: 00000100:00100000:3.0:1788869330.331430:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.331450:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324952832 00000100:00100000:3.0:1788869330.331454:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324952832 00000100:00100000:3.0:1788869330.331470:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869330.331474:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b2164c17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875765324952832:12345-0@lo:1000: 00000100:00100000:3.0:1788869330.331576:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b2164c17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875765324952832:12345-0@lo:1000: Request processed in 101us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869330.331581:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869330.332010:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3c5ae1b going to sleep for 11 seconds 00000100:00100000:3.0:1788869330.332037:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324952832:0@lo:1000: 00000100:00100000:3.0:1788869330.332082:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324952960:0@lo:700: 00000100:00100000:3.0:1788869330.332178:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.332211:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324952960 00000100:00100000:3.0:1788869330.332216:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324952960 00000100:00100000:3.0:1788869330.332244:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869330.332251:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000016d342d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875765324952960:12345-0@lo:700: 00000100:00100000:3.0:1788869330.332288:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000016d342d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875765324952960:12345-0@lo:700: Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869330.332295:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869330.332310:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0470c0a going to sleep for 11 seconds 00000100:00100000:3.0:1788869330.332321:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324952960:0@lo:700: 00000100:00100000:3.0:1788869330.332487:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324953088:0@lo:1000: 00000100:00100000:0.0:1788869330.332647:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6237ebb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324952704:0@lo:41: 00000100:00100000:3.0:1788869330.333098:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.333225:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2a482a8 going to sleep for 11 seconds 00000100:00100000:2.0:1788869330.333483:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324953088 00000100:00100000:2.0:1788869330.333490:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324953088 00000100:00100000:3.0:1788869330.334104:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869330.334124:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7305c27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875765324953088:12345-0@lo:1000: 00000100:00100000:3.0:1788869330.334215:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7305c27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875765324953088:12345-0@lo:1000: Request processed in 94us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869330.334222:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869330.334398:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c21a2990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324953088:0@lo:1000: 00000004:00080000:2.0:1788869330.334453:0:7832:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b0470c0a with version 0 00000020:00100000:2.0:1788869330.334489:0:7832:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788869330.334506:0:7832:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000098dd4c3 x1875765324953344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869330.334523:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000098dd4c3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324953344:0@lo:1000: 00000100:00100000:2.0:1788869330.334551:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869330.335171:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1c16a28 going to sleep for 11 seconds 00000100:00100000:1.0:1788869330.337396:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324953344 00000100:00100000:1.0:1788869330.337416:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324953344 00000100:00100000:1.0:1788869330.337555:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869330.337569:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006fb14900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7832:x1875765324953344:12345-0@lo:1000: 00000001:00080000:1.0:1788869330.340449:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788869330.340463:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788869330.341069:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006fb14900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7832:x1875765324953344:12345-0@lo:1000: Request processed in 3499us (6513us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788869330.341084:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1788869330.341220:0:7832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788869330.341226:0:7832:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788869330.341245:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000098dd4c3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324953344:0@lo:1000: 00000100:00100000:3.0:1788869330.341347:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000923c4c60 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324953472:0@lo:1000: 00000100:00100000:3.0:1788869330.341388:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869330.341423:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324953472 00000100:00100000:3.0:1788869330.341429:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324953472 00000100:00100000:2.0:1788869330.342097:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869330.342315:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007269ef8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7832:x1875765324953472:12345-0@lo:1000: 00000100:00100000:2.0:1788869330.342431:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007269ef8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7832:x1875765324953472:12345-0@lo:1000: Request processed in 324us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869330.342439:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869330.343104:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3c5ae1b going to sleep for 11 seconds 00000100:00100000:3.0:1788869330.343215:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000923c4c60 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875765324953472:0@lo:1000: 00000040:00080000:3.0:1788869330.343243:0:7832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788869330.343284:0:7832:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b0470c0a with version 1 00000004:00080000:1.0:1788869330.346855:0:7829:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000021b5a56e version 1 rpc_version 1 00000020:00100000:1.0:1788869330.346912:0:7829:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788869330.347005:0:7829:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000021541a5b x1875765324953728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869330.347041:0:7829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021541a5b pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7829:1875765324953728:0@lo:1000: 00000100:00100000:1.0:1788869330.347566:0:7829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869330.347695:0:7829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e49fb4db going to sleep for 11 seconds 00000040:00080000:3.0:1788869330.348015:0:7832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788869330.348105:0:7832:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788869330.348233:0:7832:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1788869330.348439:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324953728 00000100:00100000:2.0:1788869330.348455:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324953728 00000100:00100000:3.0:1788869330.349006:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869330.349018:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea01d5be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7829:x1875765324953728:12345-0@lo:1000: 00000001:00080000:2.0:1788869330.381756:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788869330.382394:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea01d5be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7829:x1875765324953728:12345-0@lo:1000: Request processed in 33375us (34824us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788869330.382430:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1788869330.385770:0:7829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788869330.385782:0:7829:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788869330.385804:0:7829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021541a5b pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7829:1875765324953728:0@lo:1000: 00010000:00010000:2.0:1788869331.142963:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869332.165871:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869332.343676:0:7884:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869332.343886:0:7884:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869333.189863:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869333.318514:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869333.318538:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021541a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324953856:0@lo:41: 00000100:00100000:3.0:1788869333.318650:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869333.318824:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324953856 00000100:00100000:0.0:1788869333.318832:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324953856 00000100:00100000:0.0:1788869333.318891:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869333.318900:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000923c4c60 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324953856:12345-0@lo:41: 00000004:00000024:0.0:1788869333.318938:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788869333.319001:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000923c4c60 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324953856:12345-0@lo:41: Request processed in 102us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869333.319007:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869333.319405:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021541a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324953856:0@lo:41: 00000020:00000080:1.0:1788869333.448303:0:7932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc50a5de0 20000000:00000080:1.0:1788869333.448323:0:7932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2840b95400 uarg=0000000000000000 20000000:01000000:1.0:1788869333.448372:0:7932:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788869333.448382:0:7932:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788869333.448388:0:7932:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788869333.448494:0:7932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788869333.448515:0:7932:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788869333.466063:0:7932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869333.466336:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788869333.466373:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788869333.466388:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788869333.466405:0:7932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788869333.466426:0:7932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869333.466446:0:7932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce444 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869333.466459:0:7932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce532 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869333.466465:0:7932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869333.466506:0:7932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce532 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869333.466521:0:7932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce532 expref: 17 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869333.466535:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d7c8daa9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1875765324953984:0@lo:104: 00000100:00100000:0.0:1788869333.466651:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869333.466714:0:7932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce444 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869333.466722:0:7932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce444 expref: 17 pid: 6519 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869333.466729:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1eaef4e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1875765324954112:0@lo:104: 00000100:00100000:0.0:1788869333.466750:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set 00000000913ff5de going to sleep for 11 seconds 00000100:00100000:3.0:1788869333.466841:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788869333.466861:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869333.466888:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324953984 00000100:00100000:3.0:1788869333.466896:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324953984 00000100:00100000:3.0:1788869333.466940:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324954112 00000100:00100000:3.0:1788869333.466943:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324954112 00000100:00100000:3.0:1788869333.466957:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869333.466977:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000351dcba3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:7932:x1875765324953984:12345-0@lo:104: 00010000:00010000:3.0:1788869333.466990:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467058:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869333.467064:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000351dcba3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:7932:x1875765324953984:12345-0@lo:104: Request processed in 100us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869333.467072:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869333.467117:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869333.467123:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b618c46a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:7932:x1875765324954112:12345-0@lo:104: 00010000:00010000:3.0:1788869333.467130:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467162:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869333.467174:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b618c46a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:7932:x1875765324954112:12345-0@lo:104: Request processed in 52us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869333.467180:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788869333.467198:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869333.467204:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467212:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000608fa9c already unused, calling callback (000000008cf644ed) 10000000:00010000:3.0:1788869333.467217:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467225:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869333.467231:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869333.467237:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869333.467270:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467277:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869333.467294:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467300:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000000608fa9c/0x4c16c38a9b6ce532 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce539 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467314:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869333.467317:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467331:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000086da16 already unused, calling callback (000000008cf644ed) 10000000:00010000:3.0:1788869333.467333:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467339:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869333.467344:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869333.467349:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869333.467360:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467365:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869333.467379:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467384:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000000086da16/0x4c16c38a9b6ce444 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce44b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467400:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869333.467401:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869333.467403:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869333.467409:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869333.467419:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003982ed94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324954240:0@lo:103: 00000100:00100000:3.0:1788869333.467447:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869333.467492:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fbeeeb46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324954368:0@lo:103: 00000100:00100000:3.0:1788869333.467523:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869333.467555:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324954240 00000100:00100000:3.0:1788869333.467559:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324954240 00010000:00010000:3.0:1788869333.467576:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce532 expref: 18 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869333.467626:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324954368 00000100:00100000:3.0:1788869333.467629:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324954368 00010000:00010000:3.0:1788869333.467639:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce444 expref: 19 pid: 6519 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869333.467652:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869333.467657:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006afc795d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:3649:x1875765324954240:12345-0@lo:103: 00010000:00010000:3.0:1788869333.467669:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869333.467673:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce532 expref: 19 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467682:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce532 expref: 19 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869333.467685:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d7c8daa9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1875765324953984:0@lo:104: 00010000:00010000:3.0:1788869333.467693:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000344ebfa/0x4c16c38a9b6ce539 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce532 expref: 19 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869333.467694:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1eaef4e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1875765324954112:0@lo:104: 00010000:00010000:3.0:1788869333.467707:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869333.467714:0:7932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869333.467730:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006afc795d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:3649:x1875765324954240:12345-0@lo:103: Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869333.467736:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869333.467748:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869333.467752:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe322cab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:3650:x1875765324954368:12345-0@lo:103: 00010000:00010000:3.0:1788869333.467759:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869333.467769:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce444 expref: 17 pid: 6519 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467776:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce444 expref: 17 pid: 6519 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467785:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ad331d5/0x4c16c38a9b6ce44b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce444 expref: 17 pid: 6519 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467796:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467804:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467817:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467823:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467829:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467834:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467838:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008295f894 already unused, calling callback (00000000c6f56d4a) 00010000:00010000:3.0:1788869333.467842:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467850:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467877:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869333.467886:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869333.467914:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe322cab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:3650:x1875765324954368:12345-0@lo:103: Request processed in 162us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869333.467920:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869333.467950:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fbeeeb46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324954368:0@lo:103: 00000100:00100000:3.0:1788869333.467980:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003982ed94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324954240:0@lo:103: 00010000:00010000:1.0:1788869333.468316:0:7932:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869333.468324:0:7932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869333.468329:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008295f894/0x4c16c38a9b6ce5cc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869334.214714:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869335.237732:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869335.366876:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021541a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324954880:0@lo:400: 00000100:00100000:1.0:1788869335.366966:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869335.367023:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788869335.367029:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004aad272e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324954496:0@lo:400: 00000100:00100000:1.0:1788869335.367060:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869335.367083:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324955008:0@lo:400: 00000100:00100000:1.0:1788869335.367120:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869335.367146:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007daf1df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324954624:0@lo:400: 00000100:00100000:1.0:1788869335.367169:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869335.367186:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869335.367191:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa60bd02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324954752:0@lo:400: 00000100:00100000:1.0:1788869335.367212:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869335.367341:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324954496 00000100:00100000:2.0:1788869335.367349:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324954496 00000100:00100000:2.0:1788869335.367404:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869335.367413:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:3650:x1875765324954496:12345-0@lo:400: 00000100:00100000:2.0:1788869335.367467:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:3650:x1875765324954496:12345-0@lo:400: Request processed in 55us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869335.367474:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869335.367569:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004aad272e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324954496:0@lo:400: 00000100:00100000:3.0:1788869335.367837:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324955008 00000100:00100000:3.0:1788869335.367843:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324955008 00000100:00100000:3.0:1788869335.367868:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324954752 00000100:00100000:3.0:1788869335.367872:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324954752 00000100:00100000:3.0:1788869335.367887:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869335.367893:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e354c54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324955008:12345-0@lo:400: 00000100:00100000:3.0:1788869335.367956:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e354c54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324955008:12345-0@lo:400: Request processed in 63us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869335.367963:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869335.367977:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788869335.367983:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053e88363 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324954752:12345-0@lo:400: 00000100:00100000:3.0:1788869335.368013:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053e88363 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324954752:12345-0@lo:400: Request processed in 30us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869335.368019:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869335.368125:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa60bd02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324954752:0@lo:400: 00000100:00100000:1.0:1788869335.368150:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094f7be14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324955008:0@lo:400: 00000100:00100000:0.0:1788869335.371468:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324954880 00000100:00100000:0.0:1788869335.371486:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324954880 00000100:00100000:0.0:1788869335.371546:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324954624 00000100:00100000:0.0:1788869335.371550:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324954624 00000100:00100000:0.0:1788869335.371569:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869335.371577:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cedc2c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324954880:12345-0@lo:400: 00000100:00100000:0.0:1788869335.371700:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cedc2c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324954880:12345-0@lo:400: Request processed in 123us (4734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869335.371716:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869335.371734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869335.371739:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ad13e31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324954624:12345-0@lo:400: 00000100:00100000:0.0:1788869335.371779:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ad13e31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324954624:12345-0@lo:400: Request processed in 40us (4610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869335.371784:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788869335.372209:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000007daf1df x1875765324954624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869335.372225:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007daf1df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324954624:0@lo:400: 00010000:00080000:0.0:1788869335.372264:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000021541a5b x1875765324954880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869335.372273:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021541a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324954880:0@lo:400: 00000100:00100000:1.0:1788869335.372998:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003982ed94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324955136:0@lo:41: 00000100:00100000:1.0:1788869335.373052:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869335.373109:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324955136 00000100:00100000:1.0:1788869335.373115:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324955136 00000100:00100000:1.0:1788869335.373151:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869335.373158:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094f7be14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324955136:12345-0@lo:41: 00000004:00000024:1.0:1788869335.373189:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788869335.373231:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094f7be14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324955136:12345-0@lo:41: Request processed in 74us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869335.373248:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869335.373287:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003982ed94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324955136:0@lo:41: 00010000:00010000:3.0:1788869336.261939:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869337.289058:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869338.309839:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869338.438267:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa60bd02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324955264:0@lo:41: 00000100:00100000:0.0:1788869338.438342:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869338.438635:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324955264 00000100:00100000:3.0:1788869338.438647:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324955264 00000100:00100000:3.0:1788869338.438703:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869338.438711:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001696c96b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324955264:12345-0@lo:41: 00000004:00000024:3.0:1788869338.438752:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788869338.446601:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001696c96b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324955264:12345-0@lo:41: Request processed in 7869us (8237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869338.446619:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869338.450912:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa60bd02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324955264:0@lo:41: 00010000:00010000:3.0:1788869339.335304:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869340.362447:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788869340.485704:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869340.485713:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282daf5000 from 1 10000000:01000000:3.0:1788869340.485719:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869340.485771:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000ac802f73/0x4c16c38a9b6ce5d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869340.485787:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000ac802f73/0x4c16c38a9b6ce5d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869340.485799:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000ac802f73/0x4c16c38a9b6ce5d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869340.485825:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fbeeeb46 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324955392:0@lo:101: 00000100:00100000:3.0:1788869340.485928:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869340.485990:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef466457 going to sleep for 11 seconds 00000100:00100000:2.0:1788869340.487328:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324955392 00000100:00100000:2.0:1788869340.487342:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324955392 00000100:00100000:2.0:1788869340.487421:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869340.487431:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c50295f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324955392:12345-0@lo:101: 00010000:00010000:2.0:1788869340.487446:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869340.487464:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000608fa9c/0x4c16c38a9b6ce5da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce5d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869340.487490:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000608fa9c/0x4c16c38a9b6ce5da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce5d3 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869340.487502:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000608fa9c/0x4c16c38a9b6ce5da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce5d3 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869340.487511:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000608fa9c, rc 0) 00000100:00100000:2.0:1788869340.487615:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c50295f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324955392:12345-0@lo:101: Request processed in 185us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869340.487639:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869340.487669:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fbeeeb46 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324955392:0@lo:101: 00010000:00010000:0.0:1788869340.487689:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000ac802f73/0x4c16c38a9b6ce5d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869340.487698:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000ac802f73/0x4c16c38a9b6ce5d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869340.487767:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cb82bd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324955520:0@lo:501: 00000100:00100000:0.0:1788869340.487801:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869340.487864:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a9b4d40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869340.487979:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324955520 00000100:00100000:2.0:1788869340.487984:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324955520 00000100:00100000:2.0:1788869340.488022:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869340.488029:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b262c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324955520:12345-0@lo:501: 00000100:00100000:2.0:1788869340.488153:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b262c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324955520:12345-0@lo:501: Request processed in 124us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869340.488161:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869340.488192:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cb82bd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324955520:0@lo:501: 00000100:00100000:2.0:1788869340.488241:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324955648:0@lo:503: 00000100:00100000:2.0:1788869340.488284:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869340.488299:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b9b770c going to sleep for 11 seconds 00000100:00100000:2.0:1788869340.488311:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324955648 00000100:00100000:2.0:1788869340.488315:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324955648 00000100:00100000:2.0:1788869340.488332:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788869340.488337:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db0061c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324955648:12345-0@lo:503: 00000100:00100000:2.0:1788869340.488420:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db0061c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324955648:12345-0@lo:503: Request processed in 83us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869340.488427:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788869340.488469:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324955648:0@lo:503: 00000100:00100000:2.0:1788869340.488671:0:8259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8259:1875765324955776:0@lo:502: 00000100:00100000:2.0:1788869340.488705:0:8259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869340.488722:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324955776 00000100:00100000:2.0:1788869340.488726:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324955776 00000100:00100000:2.0:1788869340.488741:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869340.488752:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c610da85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:8259:x1875765324955776:12345-0@lo:502: 00000100:00100000:2.0:1788869340.488814:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c610da85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:8259:x1875765324955776:12345-0@lo:502: Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869340.488821:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869340.489214:0:8259:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f8dcba2 going to sleep for 11 seconds 00000100:00100000:2.0:1788869340.489229:0:8259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cfedfc8b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8259:1875765324955776:0@lo:502: 00000020:01000000:2.0:1788869340.489251:0:8259:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869340.489260:0:8259:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869340.489263:0:8259:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788869340.489270:0:8259:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e282daf5000 00000020:00000080:2.0:1788869340.489272:0:8259:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788869340.489321:0:8259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8259:1875765324955904:0@lo:502: 00000100:00100000:2.0:1788869340.489358:0:8259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869340.489381:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324955904 00000100:00100000:2.0:1788869340.489385:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324955904 00000100:00100000:2.0:1788869340.489405:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869340.489411:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:8259:x1875765324955904:12345-0@lo:502: 00000100:00100000:2.0:1788869340.489477:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:8259:x1875765324955904:12345-0@lo:502: Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869340.489483:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869340.489509:0:8259:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869340.489519:0:8259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8259:1875765324955904:0@lo:502: 00000020:01000000:2.0:1788869340.489535:0:8259:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869340.489539:0:8259:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869340.489540:0:8259:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788869340.489544:0:8259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788869340.489623:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788869340.489648:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869340.489657:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869340.489666:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869340.489676:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869340.489679:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e281757b800 from 1 10000000:01000000:2.0:1788869340.489681:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869340.489703:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869340.489711:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869340.489719:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869340.489729:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324956032:0@lo:101: 00000100:00100000:2.0:1788869340.489754:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869340.489767:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869340.489779:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324956032 00000100:00100000:2.0:1788869340.489782:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324956032 00000100:00100000:2.0:1788869340.489799:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869340.489804:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324956032:12345-0@lo:101: 00010000:00010000:2.0:1788869340.489812:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869340.489823:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce5e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869340.490107:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce5e1 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869340.490126:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce5e1 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869340.490135:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842043c00, rc 0) 00000100:00100000:2.0:1788869340.490215:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324956032:12345-0@lo:101: Request processed in 409us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869340.490221:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788869340.490408:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324956288:0@lo:400: 00000100:00100000:1.0:1788869340.490442:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869340.490467:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869340.490473:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324956160:0@lo:400: 00000100:00100000:1.0:1788869340.490499:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869340.490523:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324956416:0@lo:400: 00000100:00100000:1.0:1788869340.490546:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869340.490563:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869340.490568:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324956544:0@lo:400: 00000100:00100000:1.0:1788869340.490628:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869340.490657:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324956288 00000100:00100000:1.0:1788869340.490663:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324956288 00000100:00100000:1.0:1788869340.490691:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324956544 00000100:00100000:1.0:1788869340.490693:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324956544 00000100:00100000:1.0:1788869340.490707:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869340.490714:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324956288:12345-0@lo:400: 00000100:00100000:1.0:1788869340.490758:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324956288:12345-0@lo:400: Request processed in 44us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869340.490765:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869340.490795:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869340.490802:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324956544:12345-0@lo:400: 00000100:00100000:1.0:1788869340.490833:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324956544:12345-0@lo:400: Request processed in 32us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869340.490851:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869340.490894:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324956288:0@lo:400: 00000100:00100000:1.0:1788869340.490919:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324956544:0@lo:400: 00000100:00100000:1.0:1788869340.492508:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324956160 00000100:00100000:1.0:1788869340.492521:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324956160 00000100:00100000:1.0:1788869340.492576:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324956416 00000100:00100000:1.0:1788869340.492579:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324956416 00000100:00100000:1.0:1788869340.492611:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869340.492621:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324956160:12345-0@lo:400: 00000100:00100000:2.0:1788869340.492639:0:6524:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788869340.492651:0:6524:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788869340.492726:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324956160:12345-0@lo:400: Request processed in 106us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869340.492734:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869340.492753:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869340.492762:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324956416:12345-0@lo:400: 00000100:00100000:3.0:1788869340.493352:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324956032:0@lo:101: 00010000:00010000:3.0:1788869340.493380:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869340.493394:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869340.493483:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324956672:0@lo:501: 00000100:00100000:3.0:1788869340.493528:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869340.493624:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28092b0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869340.495724:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324956416:12345-0@lo:400: Request processed in 2953us (5166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869340.495741:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788869340.496938:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e28179e7100 x1875765324956160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869340.496960:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324956160:0@lo:400: 00010000:00080000:3.0:1788869340.498056:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e28179e6d80 x1875765324956416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869340.498072:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324956416:0@lo:400: 00000100:00100000:3.0:1788869340.500571:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324956800:0@lo:41: 00000100:00100000:3.0:1788869340.500669:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869340.500733:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324956800 00000100:00100000:3.0:1788869340.500742:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324956800 00000100:00100000:3.0:1788869340.500792:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869340.500802:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324956800:12345-0@lo:41: 00000004:00000024:3.0:1788869340.500859:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788869340.500910:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324956800:12345-0@lo:41: Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869340.500918:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869340.500978:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324956800:0@lo:41: 00000100:00100000:2.0:1788869340.502354:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324956672 00000100:00100000:2.0:1788869340.502370:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324956672 00000100:00100000:2.0:1788869340.502444:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869340.502454:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324956672:12345-0@lo:501: 00000100:00100000:2.0:1788869340.502658:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324956672:12345-0@lo:501: Request processed in 205us (9128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869340.502665:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869340.503023:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324956672:0@lo:501: 00000100:00100000:3.0:1788869340.503079:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324956928:0@lo:503: 00000100:00100000:3.0:1788869340.503141:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869340.503174:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28092b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869340.503778:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324956928 00000100:00100000:0.0:1788869340.503786:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324956928 00000100:00100000:0.0:1788869340.503823:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788869340.503832:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324956928:12345-0@lo:503: 00000100:00100000:0.0:1788869340.503969:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324956928:12345-0@lo:503: Request processed in 138us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869340.503977:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788869340.504111:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324956928:0@lo:503: 00000100:00100000:0.0:1788869340.504968:0:8263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8263:1875765324957056:0@lo:502: 00000100:00100000:0.0:1788869340.512713:0:8263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869340.512766:0:8263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282dbb73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869340.513415:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324957056 00000100:00100000:2.0:1788869340.513430:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324957056 00000100:00100000:2.0:1788869340.513496:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869340.513507:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:8263:x1875765324957056:12345-0@lo:502: 00000100:00100000:2.0:1788869340.513743:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:8263:x1875765324957056:12345-0@lo:502: Request processed in 236us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869340.513751:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788869340.519563:0:8263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8263:1875765324957056:0@lo:502: 00000020:01000000:0.0:1788869340.519639:0:8263:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869340.519652:0:8263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869340.519654:0:8263:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788869340.519663:0:8263:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e281757b800 00000020:00000080:0.0:1788869340.519666:0:8263:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788869340.519712:0:8263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8263:1875765324957184:0@lo:502: 00000100:00100000:0.0:1788869340.519802:0:8263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869340.519850:0:8263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282dbb73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869340.522760:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324957184 00000100:00100000:3.0:1788869340.522778:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324957184 00000100:00100000:3.0:1788869340.522858:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788869340.522877:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:8263:x1875765324957184:12345-0@lo:502: 00000100:00100000:3.0:1788869340.523065:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:8263:x1875765324957184:12345-0@lo:502: Request processed in 189us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869340.523073:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788869340.523719:0:8263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8263:1875765324957184:0@lo:502: 00000020:01000000:1.0:1788869340.523761:0:8263:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869340.523920:0:8263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869340.523923:0:8263:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788869340.523929:0:8263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788869340.525437:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788869340.525470:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869340.525482:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869340.525496:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869341.392839:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869342.406153:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869343.431551:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869343.559948:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324957312:0@lo:41: 00000100:00100000:3.0:1788869343.560023:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869343.560195:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324957312 00000100:00100000:1.0:1788869343.560210:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324957312 00000100:00100000:1.0:1788869343.560263:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788869343.560274:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324957312:12345-0@lo:41: 00000004:00000024:1.0:1788869343.560312:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788869343.560382:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324957312:12345-0@lo:41: Request processed in 110us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869343.560389:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869343.560520:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324957312:0@lo:41: 00000020:01000004:2.0:1788869343.604950:0:8434:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788869343.604961:0:8434:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788869343.604962:0:8434:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788869343.605111:0:8434:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e283b46c800 00000020:01000004:2.0:1788869343.605129:0:8434:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788869343.605143:0:8434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788869343.605170:0:8434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e2840d83380) 00000020:00000080:2.0:1788869343.605189:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788869343.661021:0:8434:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788869343.661077:0:8434:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1788869343.675472:0:8434:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788869343.675887:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788869343.675900:0:8434:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788869343.675913:0:8434:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4c16c38a9b6ce5f6 00000020:01000004:1.0:1788869343.675920:0:8434:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788869343.675943:0:8434:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788869343.675947:0:8434:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788869343.675953:0:8434:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788869343.675958:0:8434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788869343.675979:0:8434:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e28411e3380) 00000020:00000080:1.0:1788869343.675992:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1788869343.678115:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869343.679870:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788869343.679881:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788869343.684576:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788869343.684970:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788869343.685515:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788869343.685522:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788869343.688555:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869343.688880:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788869343.688886:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788869343.689702:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788869343.689710:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788869343.726701:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869343.726951:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788869343.726958:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788869343.728884:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788869343.728897:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788869343.731023:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788869343.731038:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788869343.733919:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869343.734127:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788869343.734133:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788869343.734938:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788869343.734946:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788869343.827807:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869343.828723:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788869343.828732:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788869343.835533:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788869343.835550:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788869343.841456:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788869343.841575:0:8434:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788869343.841582:0:8434:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788869343.885388:0:8434:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788869343.885427:0:8434:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788869343.885435:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788869343.885436:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869343.885438:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869343.885439:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869343.885440:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869343.885441:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869343.885442:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869343.885444:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869343.885445:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869343.885446:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869343.885447:0:8434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869343.886250:0:8434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788869343.886256:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869343.886257:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869343.886258:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869343.886259:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869343.886260:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869343.886262:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869343.886263:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869343.886264:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869343.886265:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869343.886266:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869343.886267:0:8434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869343.886295:0:8434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788869343.886315:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324957440:0@lo:253: 00000100:00100000:3.0:1788869343.886387:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869343.886504:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869343.886549:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324957440 00000100:00100000:0.0:1788869343.886557:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324957440 00000100:00100000:0.0:1788869343.886905:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788869343.886916:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:8434:x1875765324957440:12345-0@lo:253: 20000000:01000000:0.0:1788869343.886974:0:6519:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788869343.886979:0:6519:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788869343.886984:0:6519:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788869343.886988:0:6519:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788869343.887326:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869343.887818:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788869343.887835:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788869343.887855:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788869343.887862:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788869343.887892:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788869343.887911:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788869343.888004:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788869343.888020:0:6519:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:0.0:1788869343.888023:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788869343.888037:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788869343.888043:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788869343.888057:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788869343.888063:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:0.0:1788869343.888077:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788869343.888084:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788869343.888097:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788869343.888115:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788869343.888211:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788869343.888223:0:6519:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:0.0:1788869343.888225:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788869343.888240:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788869343.888245:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788869343.888259:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788869343.888265:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:0.0:1788869343.888279:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788869343.888285:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788869343.888299:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788869343.888314:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788869343.889252:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788869343.889272:0:6519:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:0.0:1788869343.889274:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788869343.889291:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788869343.889299:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788869343.889332:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788869343.889339:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:0.0:1788869343.889353:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788869343.889361:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788869343.889374:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788869343.889390:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788869343.889404:0:6519:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788869343.889406:0:6519:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788869343.889409:0:6519:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788869343.889454:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788869343.889457:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869343.890162:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869343.890189:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869343.890206:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788869343.890413:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788869343.890438:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788869343.890455:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788869343.890475:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788869343.890477:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788869343.891202:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788869343.891226:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788869343.891243:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788869343.891419:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788869343.892483:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788869343.892504:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1788869343.892517:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788869343.892520:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788869343.893316:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788869343.900262:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788869343.900301:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788869343.900317:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788869343.900327:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788869343.900330:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869343.902192:0:8456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869343.902250:0:8456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869343.902269:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788869343.902492:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788869343.902519:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788869343.902536:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1788869343.902555:0:6519:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788869343.902583:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902653:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce4d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce4c9 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902662:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce540 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902669:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce57f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce578 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902687:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce59b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce594 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902695:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6ce5c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce5be expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902703:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902745:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6ce5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce5be expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902758:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6ce5c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5be expref: 18 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.902791:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324957568:0@lo:104: 00000100:00100000:1.0:1788869343.902853:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869343.902905:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce594 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902925:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce59b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce594 expref: 18 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.902935:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324957696:0@lo:104: 00000100:00100000:1.0:1788869343.902958:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869343.902988:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce578 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.902996:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce578 expref: 18 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.903004:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324957824:0@lo:104: 00000100:00100000:1.0:1788869343.903025:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869343.903040:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce540 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.903048:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce547 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce540 expref: 18 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.903056:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324957952:0@lo:104: 00000100:00100000:1.0:1788869343.903074:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869343.903090:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce4c9 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.903098:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce4d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce4c9 expref: 18 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.903105:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324958080:0@lo:104: 00000100:00100000:1.0:1788869343.903132:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869343.903144:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2811aa9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869343.903531:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324957568 00000100:00100000:2.0:1788869343.903541:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324957568 00000100:00100000:2.0:1788869343.903627:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324957696 00000100:00100000:2.0:1788869343.903631:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324957696 00000100:00100000:2.0:1788869343.903644:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324957824 00000100:00100000:2.0:1788869343.903646:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324957824 00000100:00100000:2.0:1788869343.903656:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324957952 00000100:00100000:2.0:1788869343.903659:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324957952 00000100:00100000:2.0:1788869343.903668:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324958080 00000100:00100000:2.0:1788869343.903670:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324958080 00000100:00100000:2.0:1788869343.903697:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869343.903705:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+7:6519:x1875765324957568:12345-0@lo:104: 00010000:00010000:2.0:1788869343.903719:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6ce5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.903795:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869343.903801:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+7:6519:x1875765324957568:12345-0@lo:104: Request processed in 97us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.903819:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869343.903834:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869343.903840:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:6519:x1875765324957696:12345-0@lo:104: 00010000:00010000:2.0:1788869343.903847:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6ce594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.903881:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869343.903887:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:6519:x1875765324957696:12345-0@lo:104: Request processed in 47us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.903892:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869343.903904:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869343.903910:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:6519:x1875765324957824:12345-0@lo:104: 00010000:00010000:2.0:1788869343.903917:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.903948:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788869343.903953:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:6519:x1875765324957824:12345-0@lo:104: Request processed in 44us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.903958:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869343.903971:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869343.903976:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6519:x1875765324957952:12345-0@lo:104: 00010000:00010000:2.0:1788869343.903983:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904009:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788869343.904013:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6519:x1875765324957952:12345-0@lo:104: Request processed in 38us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.904025:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869343.904037:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869343.904042:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6519:x1875765324958080:12345-0@lo:104: 00010000:00010000:2.0:1788869343.904050:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842043800/0x4c16c38a9b6ce4c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904077:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788869343.904081:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6519:x1875765324958080:12345-0@lo:104: Request processed in 39us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.904086:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788869343.904103:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788869343.904110:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6ce5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904118:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042a00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869343.904122:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6ce5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904131:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6ce5be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869343.904139:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6ce5be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869343.904145:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869343.904177:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6ce5be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904184:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869343.904211:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6ce5be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904218:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6ce5be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce5c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904233:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788869343.904236:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6ce594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904242:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ee00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869343.904245:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6ce594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904252:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6ce594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869343.904259:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6ce594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869343.904265:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869343.904279:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6ce594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904285:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869343.904291:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6ce594 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904298:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6ce594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce59b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904309:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788869343.904317:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904324:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869343.904327:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904334:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869343.904340:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869343.904345:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869343.904358:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904364:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869343.904380:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce578 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904386:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce57f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904396:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869343.904399:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904405:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8a00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869343.904408:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904425:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869343.904431:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869343.904435:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869343.904448:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904453:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869343.904458:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce540 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904464:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce547 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904474:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869343.904477:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842043800/0x4c16c38a9b6ce4c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904481:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043800 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869343.904484:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842043800/0x4c16c38a9b6ce4c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904489:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842043800/0x4c16c38a9b6ce4c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869343.904495:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842043800/0x4c16c38a9b6ce4c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869343.904507:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869343.904520:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842043800/0x4c16c38a9b6ce4c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904525:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869343.904530:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842043800/0x4c16c38a9b6ce4c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904536:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842043800/0x4c16c38a9b6ce4c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce4d0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.904549:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869343.904551:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869343.904552:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869343.904561:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869343.904566:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869343.904614:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324958208:0@lo:103: 00000100:00100000:2.0:1788869343.904651:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869343.904682:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324958720:0@lo:103: 00000100:00100000:2.0:1788869343.904702:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869343.904721:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869343.904726:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324958336:0@lo:103: 00000100:00100000:2.0:1788869343.904744:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869343.904769:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324958464:0@lo:103: 00000100:00100000:2.0:1788869343.904803:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869343.904814:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869343.904819:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324958592:0@lo:103: 00000100:00100000:2.0:1788869343.904850:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869343.904873:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324958208 00000100:00100000:2.0:1788869343.904879:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324958208 00010000:00010000:2.0:1788869343.904901:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6ce5c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5be expref: 19 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869343.904917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324958720 00000100:00100000:2.0:1788869343.904920:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324958720 00010000:00010000:2.0:1788869343.904931:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce4d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce4c9 expref: 20 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869343.904942:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324958336 00000100:00100000:2.0:1788869343.904944:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324958336 00010000:00010000:2.0:1788869343.904954:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce59b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce594 expref: 21 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869343.904964:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324958464 00000100:00100000:2.0:1788869343.904966:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324958464 00010000:00010000:2.0:1788869343.904976:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce57f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce578 expref: 22 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869343.904986:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324958592 00000100:00100000:2.0:1788869343.904988:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324958592 00010000:00010000:2.0:1788869343.904998:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce547 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce540 expref: 23 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869343.905010:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869343.905016:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:3648:x1875765324958208:12345-0@lo:103: 00010000:00010000:2.0:1788869343.905027:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869343.905032:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6ce5c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5be expref: 23 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905053:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6ce5c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5be expref: 23 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905069:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869343.905100:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:3648:x1875765324958208:12345-0@lo:103: Request processed in 84us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.905107:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869343.905122:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869343.905128:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3648:x1875765324958720:12345-0@lo:103: 00010000:00010000:2.0:1788869343.905136:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869343.905140:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce4d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce4c9 expref: 22 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905148:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce4d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce4c9 expref: 22 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905158:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869343.905180:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3648:x1875765324958720:12345-0@lo:103: Request processed in 52us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.905185:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869343.905197:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869343.905203:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3648:x1875765324958336:12345-0@lo:103: 00010000:00010000:2.0:1788869343.905222:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869343.905228:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce59b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce594 expref: 21 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905236:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce59b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce594 expref: 21 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905252:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869343.905274:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3648:x1875765324958336:12345-0@lo:103: Request processed in 71us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.905280:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869343.905292:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869343.905298:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3650:x1875765324958464:12345-0@lo:103: 00010000:00010000:2.0:1788869343.905305:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869343.905309:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce57f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce578 expref: 20 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905318:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce578 expref: 20 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905327:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869343.905352:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3650:x1875765324958464:12345-0@lo:103: Request processed in 54us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.905357:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869343.905369:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869343.905375:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:3650:x1875765324958592:12345-0@lo:103: 00010000:00010000:2.0:1788869343.905381:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869343.905385:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce547 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce540 expref: 19 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905393:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce547 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce540 expref: 19 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905404:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905418:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905435:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905441:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905448:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905454:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905460:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869343.905464:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905471:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905480:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.905490:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869343.905515:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:3650:x1875765324958592:12345-0@lo:103: Request processed in 141us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.905520:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869343.905610:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324958592:0@lo:103: 00000100:00100000:2.0:1788869343.905629:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324958464:0@lo:103: 00000100:00100000:2.0:1788869343.905655:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324958336:0@lo:103: 00000100:00100000:2.0:1788869343.905662:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324958208:0@lo:103: 00000100:00100000:2.0:1788869343.905668:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324958720:0@lo:103: 00010000:00010000:1.0:1788869343.906916:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6ce5c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5be expref: 18 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.906936:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324957568:0@lo:104: 00010000:00010000:1.0:1788869343.906950:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce59b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce594 expref: 17 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.906958:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324957696:0@lo:104: 00010000:00010000:1.0:1788869343.906967:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce57f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce578 expref: 16 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.906976:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324957824:0@lo:104: 00010000:00010000:1.0:1788869343.906985:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce547 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce540 expref: 15 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.906993:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324957952:0@lo:104: 00010000:00010000:1.0:1788869343.907001:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce4d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce4c9 expref: 14 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.907007:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875765324958080:0@lo:104: 00010000:00010000:1.0:1788869343.907029:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.907038:0:6519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.907043:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.907064:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce604 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788869343.907081:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788869343.916386:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:8434:x1875765324957440:12345-0@lo:253: Request processed in 29463us (29990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.916402:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788869343.916553:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324957440:0@lo:253: 10000000:01000000:3.0:1788869343.916570:0:8434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788869343.916573:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869343.916575:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869343.916577:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869343.916578:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788869343.916580:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869343.916581:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869343.916582:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869343.916631:0:8434:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788869343.916633:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869343.916634:0:8434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788869343.916659:0:8434:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e283b46c800 from lustre-OST0000 10000000:01000000:3.0:1788869343.916691:0:8434:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788869343.916694:0:8434:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788869343.916702:0:8434:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e282a933380 local copy 10000000:01000000:3.0:1788869343.916706:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788869343.916742:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869343.916753:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869343.916762:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869343.916810:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324958848:0@lo:101: 00000100:00100000:3.0:1788869343.916854:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869343.916891:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869343.917121:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324958848 00000100:00100000:2.0:1788869343.917129:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324958848 00000100:00100000:2.0:1788869343.917175:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869343.917185:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+13:8434:x1875765324958848:12345-0@lo:101: 00010000:00010000:2.0:1788869343.917197:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869343.917211:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce60b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.917235:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce60b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.917246:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce60b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.917256:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb400, rc 0) 00000100:00100000:2.0:1788869343.917301:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324958848:12345-0@lo:101: Request processed in 117us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.917307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788869343.917383:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324958848:0@lo:101: 00010000:00010000:1.0:1788869343.917397:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.917406:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.917496:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324958976:0@lo:501: 00000100:00100000:1.0:1788869343.917524:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869343.917553:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2811aa9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869343.917712:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324958976 00000100:00100000:0.0:1788869343.917717:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324958976 00000100:00100000:0.0:1788869343.917752:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788869343.917760:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324958976:12345-0@lo:501: 00000100:00100000:0.0:1788869343.917918:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324958976:12345-0@lo:501: Request processed in 159us (392us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869343.917925:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788869343.918032:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324958976:0@lo:501: 10000000:01000000:1.0:1788869343.918044:0:8434:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788869343.918062:0:8434:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788869343.918067:0:8434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.918076:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.918084:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.918108:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788869343.918144:0:8434:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e283b46c800 10000000:01000000:1.0:1788869343.918149:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788869343.918155:0:8434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788869343.918158:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869343.918162:0:8434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788869343.918165:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869343.918183:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.918192:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.918201:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.918215:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959104:0@lo:101: 00000100:00100000:1.0:1788869343.918243:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869343.918272:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2811aa9180 going to sleep for 11 seconds 00010000:00010000:2.0:1788869343.918432:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869343.918446:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.918454:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6800 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869343.918457:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.918467:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869343.918473:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869343.918480:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869343.918502:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.918508:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869343.918539:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.918547:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28029d6800/0x4c16c38a9b6ce60b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4c16c38a9b6ce612 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.918560:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869343.918562:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869343.918564:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869343.918626:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324959104 00000100:00100000:0.0:1788869343.918631:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324959104 00000100:00100000:0.0:1788869343.918663:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788869343.918670:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959104:12345-0@lo:101: 00010000:00010000:0.0:1788869343.918679:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869343.918690:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce619 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869343.918709:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce619 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869343.918720:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce619 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869343.918735:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030e00, rc 0) 00000100:00100000:0.0:1788869343.918927:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324959104:12345-0@lo:101: Request processed in 101us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869343.918935:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788869343.919026:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869343.919040:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324959232:0@lo:103: 00000100:00100000:3.0:1788869343.919073:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869343.919146:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324959232 00000100:00100000:2.0:1788869343.919152:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324959232 00000100:00100000:2.0:1788869343.919195:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869343.919202:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:3648:x1875765324959232:12345-0@lo:103: 00010000:00010000:2.0:1788869343.919220:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869343.919234:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce60b expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869343.919243:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869343.919280:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:3648:x1875765324959232:12345-0@lo:103: Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.919287:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869343.919506:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959104:0@lo:101: 00010000:00010000:1.0:1788869343.919521:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869343.919530:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869343.919651:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959360:0@lo:501: 00000100:00100000:1.0:1788869343.919681:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869343.919699:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2811aa9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869343.919749:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324959232:0@lo:103: 00000100:00100000:2.0:1788869343.919954:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324959360 00000100:00100000:2.0:1788869343.919959:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324959360 00000100:00100000:2.0:1788869343.919992:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788869343.920000:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959360:12345-0@lo:501: 00000100:00100000:2.0:1788869343.920133:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959360:12345-0@lo:501: Request processed in 133us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.920141:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788869343.920271:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959360:0@lo:501: 00000100:00100000:0.0:1788869343.920303:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959488:0@lo:503: 00000100:00100000:0.0:1788869343.920349:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869343.920946:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869343.927729:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324959488 00000100:00100000:3.0:1788869343.927746:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324959488 00000100:00100000:3.0:1788869343.928885:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788869343.928900:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959488:12345-0@lo:503: 00000100:00100000:3.0:1788869343.929105:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959488:12345-0@lo:503: Request processed in 209us (8755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869343.929113:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788869343.929217:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959488:0@lo:503: 00000040:00080000:0.0:1788869343.929523:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869343.929643:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959616:0@lo:502: 00000100:00100000:0.0:1788869343.929694:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869343.943692:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869343.951040:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324959616 00000100:00100000:2.0:1788869343.951062:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324959616 00000100:00100000:2.0:1788869343.951135:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788869343.951144:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959616:12345-0@lo:502: 00000100:00100000:2.0:1788869343.951623:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959616:12345-0@lo:502: Request processed in 477us (21926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.951632:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788869343.951674:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959616:0@lo:502: 00000040:00080000:0.0:1788869343.951981:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788869343.952015:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788869343.952028:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788869343.952040:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788869343.952052:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788869343.952065:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788869343.952108:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959744:0@lo:502: 00000100:00100000:0.0:1788869343.952161:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869343.952206:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869343.954548:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324959744 00000100:00100000:2.0:1788869343.954564:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324959744 00000100:00100000:2.0:1788869343.954636:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869343.954646:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959744:12345-0@lo:502: 00000100:00100000:2.0:1788869343.954842:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959744:12345-0@lo:502: Request processed in 196us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869343.954858:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788869343.954913:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959744:0@lo:502: 00000040:00080000:0.0:1788869343.955000:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788869343.955016:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788869343.956002:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869343.956020:0:8457:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788869343.956027:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869343.956030:0:8457:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788869343.956036:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869343.956051:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e2802bd19c0) 00000020:00000080:3.0:1788869343.956080:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788869343.956086:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788869343.956155:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e283b46c800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788869343.956163:0:8457:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788869343.956170:0:8457:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4c16c38a9b6ce62e 00010000:00010000:3.0:1788869343.970842:0:8457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788869343.971155:0:8457:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788869343.980698:0:8457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788869343.981139:0:8457:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788869343.991583:0:8457:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788869343.991834:0:8457:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788869343.999845:0:8457:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788869344.001427:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788869344.001440:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869344.001446:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869344.001449:0:8457:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788869344.001453:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869344.001458:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869344.001459:0:8457:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869344.001462:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869344.001464:0:8457:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788869344.001490:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869344.001493:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869344.001495:0:8457:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788869344.001499:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788869344.003765:0:8434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788869344.003822:0:8434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788869344.003847:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869344.003861:0:8434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869344.003870:0:8434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e283b46c800 from 1 10000000:01000000:0.0:1788869344.003873:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869344.003907:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869344.003914:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869344.003926:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869344.004045:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959872:0@lo:101: 00000100:00100000:0.0:1788869344.004117:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869344.004169:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869344.004233:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324959872 00000100:00100000:3.0:1788869344.004240:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324959872 00000100:00100000:3.0:1788869344.004293:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788869344.004303:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:8434:x1875765324959872:12345-0@lo:101: 00010000:00010000:3.0:1788869344.004320:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869344.004334:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce635 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869344.004358:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce635 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869344.004368:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce635 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869344.004376:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6800, rc 0) 00000100:00100000:3.0:1788869344.004414:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324959872:12345-0@lo:101: Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869344.004420:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869344.004973:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324959872:0@lo:101: 00010000:00010000:0.0:1788869344.004988:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869344.004998:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869344.005099:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960000:0@lo:501: 00000100:00100000:0.0:1788869344.005136:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869344.005171:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869344.005283:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324960000 00000100:00100000:2.0:1788869344.005290:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324960000 00000100:00100000:2.0:1788869344.005328:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788869344.005336:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324960000:12345-0@lo:501: 00000100:00100000:2.0:1788869344.005448:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324960000:12345-0@lo:501: Request processed in 112us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869344.005455:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788869344.005581:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960000:0@lo:501: 00000100:00100000:0.0:1788869344.005844:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960128:0@lo:503: 00000100:00100000:0.0:1788869344.005889:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869344.005919:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869344.006089:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324960128 00000100:00100000:2.0:1788869344.006095:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324960128 00000100:00100000:2.0:1788869344.006131:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788869344.006139:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324960128:12345-0@lo:503: 00000100:00100000:2.0:1788869344.006237:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324960128:12345-0@lo:503: Request processed in 99us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869344.006243:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788869344.006350:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960128:0@lo:503: 00000040:00080000:0.0:1788869344.006717:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869344.006887:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960256:0@lo:502: 00000100:00100000:0.0:1788869344.006926:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869344.007061:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869344.010521:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324960256 00000100:00100000:3.0:1788869344.010554:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324960256 00000100:00100000:2.0:1788869344.010748:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869344.010762:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324960256:12345-0@lo:502: 00000100:00100000:2.0:1788869344.011098:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324960256:12345-0@lo:502: Request processed in 338us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869344.011106:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788869344.011258:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960256:0@lo:502: 00000040:00080000:0.0:1788869344.011469:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788869344.011500:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788869344.011534:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960384:0@lo:502: 00000100:00100000:0.0:1788869344.011575:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869344.011624:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869344.011681:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324960384 00000100:00100000:3.0:1788869344.011685:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324960384 00000100:00100000:3.0:1788869344.011718:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788869344.011732:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324960384:12345-0@lo:502: 00000100:00100000:3.0:1788869344.011827:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324960384:12345-0@lo:502: Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869344.011834:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788869344.012099:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960384:0@lo:502: 00000040:00080000:2.0:1788869344.012142:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788869344.012151:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788869344.018175:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869344.018190:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869344.018194:0:8461:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788869344.018202:0:8461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e283b46c800 00000020:00000080:2.0:1788869344.018206:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869344.018219:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869344.018222:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869344.018223:0:8461:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788869344.018226:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788869344.018303:0:8434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788869344.018337:0:8434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869344.018370:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869344.018382:0:8434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869344.018432:0:8434:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788869344.018436:0:8434:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e283b46c800 10000000:01000000:1.0:1788869344.018438:0:8434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e283b46c800 10000000:01000000:1.0:1788869344.018442:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869344.018448:0:8434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e283b46c800 from 1 10000000:01000000:1.0:1788869344.018450:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869344.018484:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869344.018492:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869344.018503:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869344.018527:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960512:0@lo:101: 00000100:00100000:1.0:1788869344.018616:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869344.018656:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2810071480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869344.018926:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324960512 00000100:00100000:2.0:1788869344.018934:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324960512 00000100:00100000:2.0:1788869344.018991:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788869344.019000:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8434:x1875765324960512:12345-0@lo:101: 00010000:00010000:2.0:1788869344.019013:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869344.019026:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce643 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.019062:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce643 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.019073:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce643 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.019081:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb400, rc 0) 00000100:00100000:2.0:1788869344.019131:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324960512:12345-0@lo:101: Request processed in 132us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869344.019137:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869344.019322:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960512:0@lo:101: 00010000:00010000:1.0:1788869344.019339:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869344.019632:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869344.019736:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960640:0@lo:501: 00000100:00100000:1.0:1788869344.019783:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869344.019807:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2810071480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869344.019871:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324960640 00000100:00100000:0.0:1788869344.019878:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324960640 00000100:00100000:0.0:1788869344.019975:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788869344.020060:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324960640:12345-0@lo:501: 00000100:00100000:0.0:1788869344.020185:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324960640:12345-0@lo:501: Request processed in 127us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869344.020203:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869344.020273:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960640:0@lo:501: 00000100:00100000:1.0:1788869344.020298:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960768:0@lo:503: 00000100:00100000:1.0:1788869344.020333:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869344.020517:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2810071480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869344.023259:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324960768 00000100:00100000:0.0:1788869344.023273:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324960768 00000100:00100000:1.0:1788869344.025908:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788869344.025934:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324960768:12345-0@lo:503: 00000100:00100000:1.0:1788869344.026332:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324960768:12345-0@lo:503: Request processed in 399us (5995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869344.026342:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788869344.026651:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960768:0@lo:503: 00000040:00080000:2.0:1788869344.026976:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869344.027059:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960896:0@lo:502: 00000100:00100000:2.0:1788869344.027113:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869344.027158:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a296f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869344.027166:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324960896 00000100:00100000:0.0:1788869344.027175:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324960896 00000100:00100000:0.0:1788869344.027215:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788869344.027223:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324960896:12345-0@lo:502: 00000100:00100000:0.0:1788869344.027323:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324960896:12345-0@lo:502: Request processed in 100us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869344.027330:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788869344.027534:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324960896:0@lo:502: 00000040:00080000:2.0:1788869344.027804:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788869344.027835:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788869344.027850:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788869344.027863:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788869344.027877:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788869344.027892:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788869344.027906:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788869344.028477:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788869344.028521:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788869344.028536:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788869344.028549:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788869344.028572:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788869344.028922:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788869344.028951:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788869344.028964:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788869344.028977:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788869344.028991:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788869344.029005:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788869344.029017:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788869344.029029:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788869344.029040:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788869344.029052:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788869344.029066:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788869344.029087:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788869344.029119:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788869344.029135:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788869344.029147:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788869344.029160:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788869344.029172:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788869344.029186:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788869344.029198:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788869344.029209:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788869344.029220:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788869344.029232:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788869344.029243:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788869344.029253:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788869344.029264:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788869344.029307:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324961024:0@lo:502: 00000100:00100000:2.0:1788869344.029404:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869344.029454:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a296f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869344.030061:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324961024 00000100:00100000:1.0:1788869344.030072:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324961024 00000100:00100000:1.0:1788869344.030130:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788869344.030139:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324961024:12345-0@lo:502: 00000100:00100000:1.0:1788869344.030277:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324961024:12345-0@lo:502: Request processed in 138us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869344.030285:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869344.030331:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324961024:0@lo:502: 00000040:00080000:3.0:1788869344.030409:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788869344.030420:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788869344.031232:0:8462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788869344.031255:0:8462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e27025eb380) 00000020:00000080:3.0:1788869344.031280:0:8462:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788869344.031371:0:8462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e283b46c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788869344.031375:0:8462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e283b46c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788869344.031378:0:8462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e283b46c800 3 00010000:00080000:3.0:1788869344.031407:0:8462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e283dfeb800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869344.036720:0:8462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788869344.040690:0:8462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788869344.040767:0:8462:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869344.040798:0:8462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4c16c38a9b6ce658 00000100:00080000:2.0:1788869344.040811:0:8462:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869344.040824:0:8462:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e283dfeb800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869344.040865:0:8462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2827a5ca80 x1875765324961152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869344.040894:0:8462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788869344.042221:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324961408:0@lo:400: 00000100:00100000:1.0:1788869344.042282:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869344.042313:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869344.042318:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324961280:0@lo:400: 00000100:00100000:1.0:1788869344.042337:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869344.042444:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324961536:0@lo:400: 00000100:00100000:1.0:1788869344.042470:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869344.042502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324961408 00000100:00100000:1.0:1788869344.042509:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324961408 00000100:00100000:1.0:1788869344.042542:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324961280 00000100:00100000:1.0:1788869344.042544:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324961280 00000100:00100000:1.0:1788869344.042561:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869344.042569:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324961408:12345-0@lo:400: 00000100:00100000:1.0:1788869344.042634:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324961408:12345-0@lo:400: Request processed in 65us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869344.042641:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869344.042658:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869344.042662:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324961280:12345-0@lo:400: 00000100:00100000:1.0:1788869344.042682:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324961280:12345-0@lo:400: Request processed in 20us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869344.042688:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788869344.042719:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2840f8df80 x1875765324961280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869344.042734:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324961280:0@lo:400: 00010000:00080000:1.0:1788869344.042744:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2840f8f100 x1875765324961408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869344.042752:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324961408:0@lo:400: 00000100:00100000:3.0:1788869344.043097:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765324961152:0@lo:38: 00000100:00100000:3.0:1788869344.043137:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869344.043182:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324961536 00000100:00100000:3.0:1788869344.043186:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324961536 00000100:00100000:3.0:1788869344.043215:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788869344.043221:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324961536:12345-0@lo:400: 00000100:00100000:3.0:1788869344.043267:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324961536:12345-0@lo:400: Request processed in 46us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869344.043273:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788869344.043298:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324961152 00000100:00100000:3.0:1788869344.043307:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324961152 00000100:00100000:3.0:1788869344.043327:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869344.043332:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765324961152:12345-0@lo:38: 00010000:00080000:3.0:1788869344.043369:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:3.0:1788869344.043423:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4c16c38a9b6ce65f 00000100:00100000:0.0:1788869344.043424:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324961536:0@lo:400: 00000004:00100000:3.0:1788869344.043438:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788869344.043469:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8e283dfe9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869344.043517:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765324961152:12345-0@lo:38: Request processed in 183us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869344.043524:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788869344.044284:0:8462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788869344.044302:0:8462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8e2840d80000) 00000020:00000080:2.0:1788869344.044320:0:8462:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788869344.044418:0:8462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e283b46c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788869344.044422:0:8462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e283b46c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788869344.044425:0:8462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e283b46c800 3 00010000:00080000:2.0:1788869344.044451:0:8462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2702741800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00080000:0.0:1788869344.044986:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2827a5ca80 x1875765324961152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869344.044997:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869344.045006:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788869344.045013:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788869344.045018:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788869344.045021:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e283dfeb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788869344.045026:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765324961152:0@lo:38: 00010000:00010000:2.0:1788869344.046560:0:8462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788869344.046763:0:8462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788869344.046818:0:8462:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869344.046829:0:8462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4c16c38a9b6ce66d 00000100:00080000:2.0:1788869344.046838:0:8462:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869344.046849:0:8462:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e2702741800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869344.046893:0:8462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2827a5d180 x1875765324961664/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869344.046917:0:8462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788869344.052639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765324961664:0@lo:38: 00000100:00100000:0.0:1788869344.052750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869344.052932:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324961664 00000100:00100000:1.0:1788869344.052942:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324961664 00000100:00100000:1.0:1788869344.052991:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869344.053000:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765324961664:12345-0@lo:38: 00010000:00080000:1.0:1788869344.053048:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:1.0:1788869344.053094:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4c16c38a9b6ce674 00000004:00100000:1.0:1788869344.053111:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869344.053151:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8e2701f19800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869344.053210:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765324961664:12345-0@lo:38: Request processed in 210us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869344.053218:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788869344.053264:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2827a5d180 x1875765324961664/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869344.053276:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869344.053284:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788869344.053290:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788869344.053295:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788869344.053298:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2702741800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788869344.053303:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765324961664:0@lo:38: 00000040:00080000:2.0:1788869344.059312:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788869344.059477:0:8434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788869344.059520:0:8434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869344.059546:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.059560:0:8434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869344.059675:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788869344.059677:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869344.059679:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869344.059680:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869344.059681:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869344.059683:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869344.059684:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869344.059686:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869344.059687:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869344.059689:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869344.059691:0:8434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869344.059695:0:8434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788869344.059697:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869344.059698:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869344.059699:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869344.059701:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869344.059702:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869344.059703:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869344.059703:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869344.059704:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869344.059706:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869344.059707:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869344.059708:0:8434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869344.059736:0:8434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788869344.059758:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324961792:0@lo:253: 00000100:00100000:2.0:1788869344.059843:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869344.059885:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a2969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869344.059910:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324961792 00000100:00100000:2.0:1788869344.059929:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324961792 00000100:00100000:2.0:1788869344.059976:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788869344.059986:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324961792:12345-0@lo:253: 20000000:01000000:2.0:1788869344.060011:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788869344.060025:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788869344.082184:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788869344.082206:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788869344.082560:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788869344.082568:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788869344.082614:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869344.082640:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce56a expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869344.082650:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce586 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869344.082658:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869344.082709:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce586 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869344.082725:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce58d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce586 expref: 16 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869344.082760:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324961920:0@lo:104: 00000100:00100000:3.0:1788869344.082848:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869344.082910:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce56a expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869344.082919:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce56a expref: 16 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869344.082928:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324962048:0@lo:104: 00000100:00100000:3.0:1788869344.082948:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869344.083286:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:8434:x1875765324961792:12345-0@lo:253: Request processed in 23297us (23440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869344.083297:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788869344.083873:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8434:1875765324961792:0@lo:253: 10000000:01000000:3.0:1788869344.083886:0:8434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788869344.083889:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869344.083891:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869344.083892:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869344.083976:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869344.083977:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869344.083979:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869344.083981:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869344.083982:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869344.083983:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869344.083985:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869344.083987:0:8434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788869344.084003:0:8434:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788869344.085382:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788869344.085437:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869344.085483:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324961920 00000100:00100000:2.0:1788869344.085491:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324961920 00000100:00100000:2.0:1788869344.085524:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324962048 00000100:00100000:2.0:1788869344.085527:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324962048 00000100:00100000:2.0:1788869344.085540:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869344.085549:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6540:x1875765324961920:12345-0@lo:104: 00010000:00010000:2.0:1788869344.085566:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.085662:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869344.085669:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6540:x1875765324961920:12345-0@lo:104: Request processed in 121us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869344.085677:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869344.085716:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869344.085723:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6540:x1875765324962048:12345-0@lo:104: 00010000:00010000:2.0:1788869344.085731:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6ce56a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.085763:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869344.085779:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6540:x1875765324962048:12345-0@lo:104: Request processed in 47us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869344.085785:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788869344.085802:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869344.085808:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.085815:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7fe00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869344.085818:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869344.085825:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324961920:0@lo:104: 00010000:00010000:2.0:1788869344.085833:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869344.085834:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324962048:0@lo:104: 10000000:00010000:2.0:1788869344.085840:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869344.085846:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869344.085853:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.085879:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce586 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.085885:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869344.085920:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce586 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.085928:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce586 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce58d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.085941:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869344.085944:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6ce56a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869344.085955:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324962176:0@lo:103: 00010000:00010000:2.0:1788869344.085959:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869344.085962:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6ce56a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.085968:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6ce56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869344.085973:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6ce56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869344.085984:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869344.085999:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6ce56a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869344.086002:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869344.086005:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869344.086026:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6ce56a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.086034:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6ce56a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce571 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.086049:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869344.086051:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869344.086053:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869344.086059:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869344.086084:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324962176 00000100:00100000:2.0:1788869344.086087:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324962176 00010000:00010000:2.0:1788869344.086105:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce58d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce586 expref: 16 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869344.086135:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869344.086142:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:3649:x1875765324962176:12345-0@lo:103: 00010000:00010000:2.0:1788869344.086152:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869344.086158:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce58d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce586 expref: 16 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.086169:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce586 expref: 16 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.086195:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce58d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce586 expref: 16 pid: 6518 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.086208:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869344.086243:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:3649:x1875765324962176:12345-0@lo:103: Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869344.086250:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869344.086270:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324962304:0@lo:103: 00000100:00100000:2.0:1788869344.086293:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869344.086352:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324962176:0@lo:103: 00000100:00100000:2.0:1788869344.088497:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324962304 00000100:00100000:2.0:1788869344.088512:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324962304 00010000:00010000:2.0:1788869344.088554:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce56a expref: 15 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869344.088614:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869344.088622:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:3650:x1875765324962304:12345-0@lo:103: 00010000:00010000:2.0:1788869344.088636:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869344.088642:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce56a expref: 15 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088653:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce56a expref: 15 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088669:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce571 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce56a expref: 15 pid: 6516 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088684:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088711:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869344.088729:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012655653s 00010000:00010000:2.0:1788869344.088734:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088742:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088749:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088756:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088762:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869344.088766:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088787:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088806:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869344.088816:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869344.088843:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869344.088852:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869344.088858:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce67b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869344.088880:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:3650:x1875765324962304:12345-0@lo:103: Request processed in 258us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869344.088888:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869344.089856:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324962304:0@lo:103: 00080000:10000000:2.0:1788869344.094312:0:8434:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788869344.094535:0:8434:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788869344.094808:0:8434:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788869344.097143:0:8434:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788869344.100017:0:8434:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788869344.100683:0:8434:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788869344.102237:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788869344.116546:0:8434:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788869344.116558:0:8434:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788869344.116641:0:8434:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788869344.116694:0:8434:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788869344.116719:0:8434:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788869344.116744:0:8434:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788869344.117664:0:8434:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869344.117860:0:8434:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788869344.453950:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788869345.012073:0:8518:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869345.012288:0:8518:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869345.479288:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869345.605944:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869345.605977:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324962432:0@lo:41: 00000100:00100000:2.0:1788869345.606052:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869345.606272:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324962432 00000100:00100000:3.0:1788869345.606281:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324962432 00000100:00100000:3.0:1788869345.606339:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869345.606349:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324962432:12345-0@lo:41: 00000004:00000024:3.0:1788869345.606388:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788869345.606447:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324962432:12345-0@lo:41: Request processed in 100us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869345.606465:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869345.607098:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324962432:0@lo:41: 00010000:00010000:2.0:1788869346.502153:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869347.527236:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869348.549796:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869348.684955:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324962560:0@lo:41: 00000100:00100000:2.0:1788869348.685052:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869348.686697:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324962560 00000100:00100000:2.0:1788869348.686716:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324962560 00000100:00100000:1.0:1788869348.690676:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869348.690708:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324962560:12345-0@lo:41: 00000004:00000024:1.0:1788869348.690773:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788869348.690909:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324962560:12345-0@lo:41: Request processed in 214us (5857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869348.690917:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869348.691027:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324962560:0@lo:41: 10000000:01000000:1.0:1788869349.192918:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788869349.192925:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e282daf5000 from 30 10000000:01000000:1.0:1788869349.192929:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869349.192984:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869349.193010:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869349.193022:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869349.193054:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324962688:0@lo:101: 00000100:00100000:1.0:1788869349.193129:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869349.193175:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.193325:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324963072:0@lo:400: 00000100:00100000:3.0:1788869349.193363:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.193392:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788869349.193397:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324962944:0@lo:400: 00000100:00100000:3.0:1788869349.193422:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.193440:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324963456:0@lo:400: 00000100:00100000:3.0:1788869349.193463:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.193493:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324963072 00000100:00100000:3.0:1788869349.193502:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324963072 00000100:00100000:3.0:1788869349.193544:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324963456 00000100:00100000:3.0:1788869349.193547:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324963456 00000100:00100000:3.0:1788869349.193579:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869349.193616:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324963072:12345-0@lo:400: 00000100:00100000:3.0:1788869349.193694:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324963072:12345-0@lo:400: Request processed in 106us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.193701:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869349.193717:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869349.193725:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324963456:12345-0@lo:400: 00000100:00100000:3.0:1788869349.193751:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324963456:12345-0@lo:400: Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.193756:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869349.193774:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324962944 00000100:00100000:3.0:1788869349.193777:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324962944 00000100:00100000:3.0:1788869349.193799:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869349.193804:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324962944:12345-0@lo:400: 00000100:00100000:3.0:1788869349.193841:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324962944:12345-0@lo:400: Request processed in 37us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.193847:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788869349.193864:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869349.193891:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324962944:0@lo:400: 00010000:00080000:3.0:1788869349.193902:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f14380 x1875765324963456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869349.193911:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324963456:0@lo:400: 00010000:00080000:3.0:1788869349.193919:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f17b80 x1875765324963072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869349.193927:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324963072:0@lo:400: 00000100:00100000:2.0:1788869349.202177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324962688 00000100:00100000:2.0:1788869349.202195:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324962688 00000100:00100000:2.0:1788869349.202286:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788869349.202298:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:6521:x1875765324962688:12345-0@lo:101: 00010000:00010000:2.0:1788869349.202319:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869349.202341:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce682 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.202379:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce682 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.202391:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce682 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.202402:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb600, rc 0) 00000100:00100000:2.0:1788869349.202493:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324962688:12345-0@lo:101: Request processed in 198us (9364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869349.202500:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788869349.202557:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324962816:0@lo:400: 00000100:00100000:2.0:1788869349.202631:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.202670:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765324963328:0@lo:400: 00000100:00100000:2.0:1788869349.202697:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.202719:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869349.202725:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324963200:0@lo:400: 00000100:00100000:2.0:1788869349.202751:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.202791:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324962816 00000100:00100000:2.0:1788869349.202795:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324962816 00000100:00100000:2.0:1788869349.202822:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324963328 00000100:00100000:2.0:1788869349.202826:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324963328 00000100:00100000:2.0:1788869349.202850:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869349.202856:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324962816:12345-0@lo:400: 00000100:00100000:0.0:1788869349.203386:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324963200 00000100:00100000:0.0:1788869349.203392:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324963200 00000100:00100000:0.0:1788869349.203450:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869349.203457:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324963200:12345-0@lo:400: 00000100:00100000:0.0:1788869349.203550:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324963200:12345-0@lo:400: Request processed in 93us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869349.203557:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869349.203580:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869349.203694:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765324963328:12345-0@lo:400: 00000100:00100000:0.0:1788869349.203726:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765324963328:12345-0@lo:400: Request processed in 37us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869349.203732:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869349.203774:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324963200:0@lo:400: 00010000:00080000:0.0:1788869349.203790:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f16680 x1875765324963328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869349.203799:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765324963328:0@lo:400: 00000100:00100000:0.0:1788869349.203834:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324962688:0@lo:101: 00010000:00010000:0.0:1788869349.203854:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869349.203865:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869349.204114:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324963584:0@lo:501: 00000100:00100000:0.0:1788869349.204150:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869349.204180:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e469c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869349.204196:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324963584 00000100:00100000:0.0:1788869349.204201:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324963584 00000100:00100000:0.0:1788869349.204238:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788869349.204244:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324963584:12345-0@lo:501: 00000100:00100000:0.0:1788869349.204378:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324963584:12345-0@lo:501: Request processed in 132us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869349.204384:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788869349.204416:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324963584:0@lo:501: 00000100:00100000:0.0:1788869349.204444:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324963712:0@lo:503: 00000100:00100000:0.0:1788869349.204483:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869349.204495:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e469c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869349.204506:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324963712 00000100:00100000:0.0:1788869349.204509:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324963712 00000100:00100000:0.0:1788869349.204528:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869349.204533:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324963712:12345-0@lo:503: 00000100:00100000:0.0:1788869349.204645:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324963712:12345-0@lo:503: Request processed in 110us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869349.204664:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869349.204709:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324963712:0@lo:503: 00000100:00080000:3.0:1788869349.205829:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869349.206346:0:8719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8719:1875765324963840:0@lo:502: 00000100:00100000:1.0:1788869349.206419:0:8719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869349.206505:0:8719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869349.209029:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324962816:12345-0@lo:400: Request processed in 6165us (6391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869349.209043:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788869349.209114:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f15c00 x1875765324962816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869349.209128:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324962816:0@lo:400: 00000100:00100000:3.0:1788869349.209830:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324963840 00000100:00100000:3.0:1788869349.209840:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324963840 00000100:00100000:3.0:1788869349.209893:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788869349.209901:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8719:x1875765324963840:12345-0@lo:502: 00000100:00100000:3.0:1788869349.210048:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8719:x1875765324963840:12345-0@lo:502: Request processed in 148us (3629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.210055:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788869349.210110:0:8719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8719:1875765324963840:0@lo:502: 00000100:00100000:3.0:1788869349.210172:0:8719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8719:1875765324963968:0@lo:502: 00000100:00100000:3.0:1788869349.210207:0:8719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.210230:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324963968 00000100:00100000:3.0:1788869349.210234:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324963968 00000100:00100000:3.0:1788869349.210253:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869349.210264:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8719:x1875765324963968:12345-0@lo:502: 00000100:00100000:3.0:1788869349.210316:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:8719:x1875765324963968:12345-0@lo:502: Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.210321:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869349.210355:0:8719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.210365:0:8719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8719:1875765324963968:0@lo:502: 00000040:00080000:3.0:1788869349.210380:0:8719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788869349.210444:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788869349.210465:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869349.210476:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.210488:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869349.210497:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788869349.210500:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e282daf5000 from 5 10000000:01000000:3.0:1788869349.210502:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869349.210525:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.210533:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.210542:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869349.210552:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964096:0@lo:101: 00000100:00100000:3.0:1788869349.210574:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.210634:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.210648:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324964096 00000100:00100000:3.0:1788869349.210661:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324964096 00000100:00100000:3.0:1788869349.210681:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869349.210686:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324964096:12345-0@lo:101: 00010000:00010000:3.0:1788869349.210694:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869349.210705:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce690 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.210725:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce690 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.210735:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce690 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.210743:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6600, rc 0) 00000100:00100000:3.0:1788869349.210765:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324964096:12345-0@lo:101: Request processed in 79us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.210770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869349.210793:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964096:0@lo:101: 00010000:00010000:3.0:1788869349.210803:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.210811:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869349.210846:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964224:0@lo:256: 00000100:00100000:3.0:1788869349.210870:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.210880:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.210893:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324964224 00000100:00100000:3.0:1788869349.210896:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324964224 00000100:00100000:3.0:1788869349.210911:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869349.210916:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324964224:12345-0@lo:256: 20000000:01000000:3.0:1788869349.210927:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869349.210940:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869349.210943:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788869349.211001:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324964224:12345-0@lo:256: Request processed in 84us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.211007:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869349.211029:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964224:0@lo:256: 10000000:01000000:3.0:1788869349.211060:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788869349.211065:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.211072:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869349.211080:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788869349.211081:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788869349.211083:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788869349.211094:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.211101:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.211109:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869349.211126:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964352:0@lo:101: 00000100:00100000:3.0:1788869349.211146:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.211156:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.211165:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324964352 00000100:00100000:3.0:1788869349.211167:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324964352 00000100:00100000:3.0:1788869349.211183:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788869349.211187:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324964352:12345-0@lo:101: 00010000:00010000:3.0:1788869349.211193:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869349.211199:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.211211:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce69e expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.211219:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce69e expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.211226:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6200, rc 0) 00000100:00100000:3.0:1788869349.211246:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324964352:12345-0@lo:101: Request processed in 58us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.211251:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788869349.211271:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964352:0@lo:101: 00010000:00010000:3.0:1788869349.211279:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.211286:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869349.211332:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964480:0@lo:501: 00000100:00100000:3.0:1788869349.211352:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.211362:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.211371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324964480 00000100:00100000:3.0:1788869349.211373:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324964480 00000100:00100000:3.0:1788869349.211388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788869349.211393:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324964480:12345-0@lo:501: 00000100:00100000:3.0:1788869349.211476:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324964480:12345-0@lo:501: Request processed in 82us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.211482:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788869349.211503:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964480:0@lo:501: 00000100:00100000:3.0:1788869349.211522:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964608:0@lo:503: 00000100:00100000:3.0:1788869349.211548:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.211558:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.211566:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324964608 00000100:00100000:3.0:1788869349.211569:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324964608 00000100:00100000:3.0:1788869349.211606:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869349.211612:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324964608:12345-0@lo:503: 00000100:00100000:3.0:1788869349.211697:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324964608:12345-0@lo:503: Request processed in 85us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.211704:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869349.211737:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324964608:0@lo:503: 00000100:00100000:2.0:1788869349.212949:0:8720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8720:1875765324964736:0@lo:502: 00000100:00100000:2.0:1788869349.213006:0:8720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.213043:0:8720:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809fe0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.213187:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324964736 00000100:00100000:3.0:1788869349.213194:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324964736 00000100:00100000:3.0:1788869349.213244:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788869349.213252:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:8720:x1875765324964736:12345-0@lo:502: 00000100:00100000:3.0:1788869349.213353:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:8720:x1875765324964736:12345-0@lo:502: Request processed in 102us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.213360:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869349.213439:0:8720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8720:1875765324964736:0@lo:502: 00000020:01000000:2.0:1788869349.213463:0:8720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788869349.213470:0:8720:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788869349.213477:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869349.213479:0:8720:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788869349.213483:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788869349.213487:0:8720:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:2.0:1788869349.213510:0:8720:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788869349.213513:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869349.213528:0:8720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8e2840d84d40) 00000020:00000080:2.0:1788869349.213549:0:8720:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788869349.213554:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788869349.213666:0:8720:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788869349.213672:0:8720:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788869349.213680:0:8720:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6ce6b3 00010000:00080000:2.0:1788869349.213710:0:8720:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e283b46d800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869349.214052:0:8720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788869349.229865:0:8720:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788869349.229892:0:8720:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788869349.230108:0:8720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869349.230508:0:8720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869349.230855:0:8720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788869349.230947:0:8720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788869349.231689:0:8726:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869349.231696:0:8726:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788869349.235129:0:8720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869349.235145:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788869349.235203:0:8720:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788869349.235229:0:8720:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6ce6ba 00000100:00080000:3.0:1788869349.235300:0:8720:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869349.235311:0:8720:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e283b46d800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869349.235406:0:8720:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2840f17b80 x1875765324964864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869349.235431:0:8720:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788869349.235501:0:8720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869349.235505:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869349.235508:0:8720:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788869349.235510:0:8720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869349.235514:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869349.235515:0:8720:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869349.235518:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869349.235519:0:8720:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788869349.235550:0:8720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8720:1875765324964992:0@lo:502: 00000100:00100000:1.0:1788869349.236068:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765324964864:0@lo:8: 00000100:00100000:1.0:1788869349.236136:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.236432:0:8720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.236491:0:8720:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.236515:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324964864 00000100:00100000:3.0:1788869349.236522:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324964864 00000100:00100000:3.0:1788869349.236560:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869349.236567:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765324964864:12345-0@lo:8: 00010000:00080000:3.0:1788869349.236644:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:3.0:1788869349.236682:0:8440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6ce6c1 00002000:00100000:3.0:1788869349.236740:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e2702740000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788869349.236745:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788869349.236749:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788869349.236808:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788869349.237047:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788869349.237071:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8e2702743800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869349.237123:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765324964864:12345-0@lo:8: Request processed in 555us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.237131:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788869349.238889:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f17b80 x1875765324964864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869349.238905:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869349.238915:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788869349.238926:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788869349.238934:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788869349.238937:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e283b46d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788869349.238957:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788869349.238964:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765324964864:0@lo:8: 00000100:00100000:0.0:1788869349.239042:0:8727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8727:1875765324965120:0@lo:700: 00000100:00100000:0.0:1788869349.239106:0:8727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869349.239139:0:8727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2826812cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788869349.239176:0:8726:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788869349.239327:0:8726:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 283152739457ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788869349.239335:0:8726:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788869349.239377:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324965120 00000100:00100000:3.0:1788869349.239385:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324965120 00000100:00080000:0.0:1788869349.239417:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869349.239435:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869349.239444:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8727:x1875765324965120:12345-0@lo:700: 00000100:00100000:3.0:1788869349.239481:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8449:1875765324965248:0@lo:700: 00000100:00100000:3.0:1788869349.239511:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.239631:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324964992 00000100:00100000:2.0:1788869349.239636:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324964992 00000100:00100000:2.0:1788869349.239677:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788869349.239684:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:8720:x1875765324964992:12345-0@lo:502: 00000100:00100000:2.0:1788869349.239891:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:8720:x1875765324964992:12345-0@lo:502: Request processed in 207us (3458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869349.239898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000004:00080000:0.0:1788869349.242277:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788869349.243544:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.243774:0:8720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8720:1875765324964992:0@lo:502: 00000020:01000000:3.0:1788869349.243819:0:8720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869349.243828:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869349.243830:0:8720:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788869349.243835:0:8720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1788869349.244105:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324965248 00000100:00100000:1.0:1788869349.244114:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324965248 00000020:01000000:2.0:1788869349.244195:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1788869349.244221:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788869349.244233:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.244246:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869349.244258:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788869349.244261:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e281757b800 from 30 10000000:01000000:2.0:1788869349.244264:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869349.244298:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.244307:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.244318:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869349.244385:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869349.244404:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8449:x1875765324965248:12345-0@lo:700: 00000100:00100000:2.0:1788869349.244410:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324965376:0@lo:101: 00000100:00100000:2.0:1788869349.244486:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.244515:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a2aa240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869349.244531:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324965376 00000100:00100000:2.0:1788869349.244535:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324965376 00000100:00100000:2.0:1788869349.244570:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788869349.244577:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324965376:12345-0@lo:101: 00010000:00010000:2.0:1788869349.244605:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869349.244781:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce6c8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.244806:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce6c8 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.244817:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce6c8 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.244826:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edac00, rc 0) 00000100:00100000:2.0:1788869349.244869:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324965376:12345-0@lo:101: Request processed in 293us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869349.244877:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788869349.244958:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324965376:0@lo:101: 00010000:00010000:0.0:1788869349.244972:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869349.244980:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869349.245054:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324965504:0@lo:501: 00000100:00100000:0.0:1788869349.245080:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869349.245101:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2826812480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869349.246232:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324965504 00000100:00100000:2.0:1788869349.246244:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324965504 00000100:00100000:2.0:1788869349.246295:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788869349.246303:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324965504:12345-0@lo:501: 00000100:00100000:2.0:1788869349.246498:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324965504:12345-0@lo:501: Request processed in 195us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869349.246506:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788869349.246744:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324965504:0@lo:501: 00000100:00100000:1.0:1788869349.246849:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324965632:0@lo:503: 00000100:00100000:2.0:1788869349.247432:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.247480:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869349.247537:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324965632 00000100:00100000:0.0:1788869349.247544:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324965632 00000100:00100000:0.0:1788869349.247624:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788869349.247634:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324965632:12345-0@lo:503: 00000100:00100000:0.0:1788869349.247752:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324965632:12345-0@lo:503: Request processed in 120us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869349.247760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788869349.247989:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324965632:0@lo:503: 00000100:00100000:2.0:1788869349.248476:0:8729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8729:1875765324965760:0@lo:502: 00000100:00100000:2.0:1788869349.248522:0:8729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.248556:0:8729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a2aaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869349.249056:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324965760 00000100:00100000:0.0:1788869349.249064:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324965760 00000100:00100000:0.0:1788869349.249174:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788869349.249184:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:8729:x1875765324965760:12345-0@lo:502: 00000100:00100000:0.0:1788869349.249321:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:8729:x1875765324965760:12345-0@lo:502: Request processed in 137us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869349.249417:0:8729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8729:1875765324965760:0@lo:502: 00000100:00100000:1.0:1788869349.249472:0:8729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8729:1875765324965888:0@lo:502: 00000100:00100000:1.0:1788869349.249516:0:8729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869349.249540:0:8729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869349.249776:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788869349.249810:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324965888 00000100:00100000:0.0:1788869349.249814:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324965888 00000100:00100000:0.0:1788869349.249838:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869349.249844:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:8729:x1875765324965888:12345-0@lo:502: 00000100:00100000:0.0:1788869349.249920:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:8729:x1875765324965888:12345-0@lo:502: Request processed in 76us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869349.249926:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788869349.250198:0:8729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8729:1875765324965888:0@lo:502: 00000040:00080000:1.0:1788869349.250219:0:8729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788869349.250789:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788869349.250817:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788869349.250827:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869349.250839:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869349.250848:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869349.250851:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e281757b800 from 5 10000000:01000000:0.0:1788869349.250854:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869349.250884:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869349.250892:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869349.250902:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869349.250919:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966016:0@lo:101: 00000100:00100000:0.0:1788869349.250962:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869349.251051:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e393c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869349.264737:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324966016 00000100:00100000:2.0:1788869349.264761:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324966016 00000100:00100000:3.0:1788869349.264886:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869349.264897:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324966016:12345-0@lo:101: 00010000:00010000:3.0:1788869349.264914:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869349.264944:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce6d6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.264976:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce6d6 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.264990:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce6d6 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.265000:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8600, rc 0) 00000100:00100000:3.0:1788869349.265091:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765324966016:12345-0@lo:101: Request processed in 197us (14129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.265098:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788869349.265351:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966016:0@lo:101: 00010000:00010000:2.0:1788869349.265375:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.265386:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869349.265455:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966144:0@lo:256: 00000100:00100000:2.0:1788869349.265501:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.265544:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a2aa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.267554:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324966144 00000100:00100000:3.0:1788869349.267570:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324966144 00000100:00100000:3.0:1788869349.267642:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788869349.267662:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765324966144:12345-0@lo:256: 20000000:01000000:3.0:1788869349.267686:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869349.267944:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869349.267948:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788869349.268077:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765324966144:12345-0@lo:256: Request processed in 426us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.268085:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788869349.269044:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966144:0@lo:256: 10000000:01000000:2.0:1788869349.269106:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869349.269116:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.269127:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869349.269135:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788869349.269138:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788869349.269141:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788869349.269177:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.269184:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.269192:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869349.269207:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966272:0@lo:101: 00000100:00100000:2.0:1788869349.269260:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.269300:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a2aa480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869349.271078:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324966272 00000100:00100000:1.0:1788869349.271093:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324966272 00000100:00100000:1.0:1788869349.271156:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788869349.271166:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765324966272:12345-0@lo:101: 00010000:00010000:1.0:1788869349.271182:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869349.271201:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce6e4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869349.271244:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce6e4 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869349.271254:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce6e4 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869349.271262:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e600, rc 0) 00000100:00100000:1.0:1788869349.271346:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324966272:12345-0@lo:101: Request processed in 181us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869349.271352:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788869349.271825:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966272:0@lo:101: 00010000:00010000:0.0:1788869349.271857:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869349.271866:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869349.271943:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966400:0@lo:501: 00000100:00100000:0.0:1788869349.271985:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869349.272014:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e390c0 going to sleep for 11 seconds 40000000:02000000:0.0:1788869349.272445:0:6531:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1788869349.273619:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324966400 00000100:00100000:3.0:1788869349.273631:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324966400 00000100:00100000:3.0:1788869349.273696:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788869349.273853:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324966400:12345-0@lo:501: 00000100:00100000:3.0:1788869349.274215:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324966400:12345-0@lo:501: Request processed in 510us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.274243:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788869349.274308:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966400:0@lo:501: 00000100:00100000:3.0:1788869349.274842:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966528:0@lo:503: 00000100:00100000:3.0:1788869349.275453:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.275492:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.275515:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324966528 00000100:00100000:3.0:1788869349.275521:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324966528 00000100:00100000:3.0:1788869349.275559:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788869349.275567:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324966528:12345-0@lo:503: 00000100:00100000:1.0:1788869349.275769:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324966528:0@lo:503: 00000100:00100000:3.0:1788869349.276408:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324966528:12345-0@lo:503: Request processed in 139us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.276428:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788869349.278989:0:8730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8730:1875765324966656:0@lo:502: 00000100:00100000:3.0:1788869349.279083:0:8730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.279126:0:8730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869349.279765:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324966656 00000100:00100000:1.0:1788869349.279775:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324966656 00000100:00100000:1.0:1788869349.279836:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788869349.279847:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:8730:x1875765324966656:12345-0@lo:502: 00000100:00100000:1.0:1788869349.280006:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:8730:x1875765324966656:12345-0@lo:502: Request processed in 160us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869349.280015:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869349.280977:0:8730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8730:1875765324966656:0@lo:502: 00000020:01000000:3.0:1788869349.281017:0:8730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869349.281025:0:8730:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788869349.281034:0:8730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869349.281036:0:8730:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788869349.281041:0:8730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869349.281044:0:8730:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:3.0:1788869349.281068:0:8730:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788869349.281071:0:8730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869349.281089:0:8730:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e27025e8000) 00000020:00000080:3.0:1788869349.281113:0:8730:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788869349.281128:0:8730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869349.283495:0:8730:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788869349.283509:0:8730:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788869349.283523:0:8730:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6ce6f9 00010000:00080000:3.0:1788869349.283561:0:8730:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282dac2800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788869349.283850:0:8730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1788869349.285840:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8449:x1875765324965248:12345-0@lo:700: Request processed in 41431us (46318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869349.285854:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788869349.285860:0:8449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f15180 x1875765324965248/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869349.286002:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8449:1875765324965248:0@lo:700: 40000000:02000000:3.0:1788869349.286019:0:8449:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1788869349.312147:0:8730:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788869349.312179:0:8730:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788869349.314288:0:8730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869349.317553:0:8730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869349.317758:0:8730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788869349.317858:0:8730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000001:00100000:2.0:1788869349.325016:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788869349.325169:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8727:x1875765324965120:12345-0@lo:700: Request processed in 85722us (86059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869349.325185:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788869349.325289:0:8727:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da8bb80 x1875765324965120/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869349.325304:0:8727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8727:1875765324965120:0@lo:700: 00000040:00080000:1.0:1788869349.325402:0:8737:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869349.325406:0:8737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788869349.326232:0:8730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869349.326244:0:8730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788869349.326279:0:8730:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788869349.326302:0:8730:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6ce700 00000100:00080000:1.0:1788869349.326311:0:8730:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869349.326321:0:8730:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e282dac2800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869349.326420:0:8730:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2840f8dc00 x1875765324966784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869349.326448:0:8730:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788869349.326544:0:8730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869349.326548:0:8730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869349.326551:0:8730:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788869349.326554:0:8730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869349.326558:0:8730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869349.326560:0:8730:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788869349.326562:0:8730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788869349.326569:0:8730:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788869349.326624:0:8730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8730:1875765324966912:0@lo:502: 00000100:00100000:2.0:1788869349.326626:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765324966784:0@lo:8: 00000100:00100000:2.0:1788869349.330505:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.332682:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324966784 00000100:00100000:2.0:1788869349.332696:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324966784 00000100:00100000:2.0:1788869349.332737:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869349.332745:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765324966784:12345-0@lo:8: 00010000:00080000:2.0:1788869349.332782:0:8443:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:2.0:1788869349.332812:0:8443:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6ce707 00002000:00100000:2.0:1788869349.332829:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e27029d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788869349.332833:0:8443:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788869349.332835:0:8443:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788869349.332922:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788869349.332947:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869349.333023:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765324966784:12345-0@lo:8: Request processed in 277us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869349.333030:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788869349.333071:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8dc00 x1875765324966784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869349.333082:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869349.333090:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788869349.333097:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788869349.333102:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788869349.333105:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282dac2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788869349.333116:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788869349.333121:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765324966784:0@lo:8: 00000100:00100000:1.0:1788869349.336537:0:8730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788869349.336623:0:8737:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788869349.336722:0:8737:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 283250134758ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788869349.336730:0:8737:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788869349.336766:0:8730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869349.336798:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324966912 00000100:00100000:2.0:1788869349.336812:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324966912 00000100:00100000:2.0:1788869349.336864:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788869349.336876:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:8730:x1875765324966912:12345-0@lo:502: 00000100:00100000:2.0:1788869349.337066:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:8730:x1875765324966912:12345-0@lo:502: Request processed in 190us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869349.337074:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788869349.337435:0:8730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:8730:1875765324966912:0@lo:502: 00000020:01000000:1.0:1788869349.337470:0:8730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869349.337479:0:8730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869349.337481:0:8730:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788869349.337488:0:8730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788869349.337699:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788869349.337803:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788869349.337815:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.337827:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869349.337837:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788869349.337839:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e282a933380 from 1 10000000:01000000:3.0:1788869349.337842:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788869349.337874:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.337882:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869349.337891:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869349.337918:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324967040:0@lo:101: 00000100:00100000:3.0:1788869349.337964:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.337995:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.338906:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324967168:0@lo:13: 00000100:00100000:3.0:1788869349.338952:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788869349.338987:0:8738:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788869349.339003:0:8738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8738:1875765324967296:0@lo:7: 00000100:00100000:3.0:1788869349.339024:0:8738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.339051:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324967296 00000100:00100000:3.0:1788869349.339057:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324967296 00000100:00100000:3.0:1788869349.339108:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869349.339116:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8738:x1875765324967296:12345-0@lo:7: 00000100:00100000:1.0:1788869349.339373:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324967168 00000100:00100000:1.0:1788869349.339378:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324967168 00000100:00100000:1.0:1788869349.339411:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869349.339417:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765324967168:12345-0@lo:13: 00002000:00000024:1.0:1788869349.339434:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1788869349.339484:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765324967168:12345-0@lo:13: Request processed in 67us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869349.339491:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869349.339513:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324967040 00000100:00100000:1.0:1788869349.339516:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324967040 00000100:00100000:1.0:1788869349.339539:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788869349.339545:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324967040:12345-0@lo:101: 00010000:00010000:1.0:1788869349.339554:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869349.339570:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce70e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869349.339615:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce70e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869349.339634:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce70e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869349.339642:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7fc00, rc 0) 00000100:00100000:1.0:1788869349.339685:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765324967040:12345-0@lo:101: Request processed in 140us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869349.339691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788869349.342674:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869349.342729:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f17100 x1875765324967168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869349.342755:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324967168:0@lo:13: 00000100:00100000:1.0:1788869349.342795:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324967040:0@lo:101: 00010000:00010000:1.0:1788869349.342821:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869349.342835:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869349.342908:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324967424:0@lo:501: 00000100:00100000:1.0:1788869349.342973:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869349.343013:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27029969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869349.343025:0:8738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8b40 going to sleep for 11 seconds 00000004:00080000:2.0:1788869349.343665:0:8727:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788869349.343686:0:8727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8727:1875765324967680:0@lo:7: 00000100:00100000:2.0:1788869349.343723:0:8727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.343752:0:8727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a2aa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869349.343768:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324967552:0@lo:13: 00000100:00100000:2.0:1788869349.343792:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869349.344642:0:8440:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788869349.344662:0:8440:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788869349.344796:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324967424 00000100:00100000:2.0:1788869349.344805:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324967424 00000100:00100000:2.0:1788869349.344851:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788869349.344859:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765324967424:12345-0@lo:501: 00000100:00100000:2.0:1788869349.344962:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765324967424:12345-0@lo:501: Request processed in 103us (1988us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869349.344969:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788869349.345019:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324967424:0@lo:501: 10000000:01000000:2.0:1788869349.345057:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788869349.345066:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869349.345077:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869349.345100:0:8443:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788869349.345106:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324967680 00000100:00100000:2.0:1788869349.345110:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324967680 00002000:00080000:3.0:1788869349.347107:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788869349.347118:0:8442:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788869349.348074:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8738:x1875765324967296:12345-0@lo:7: Request processed in 8112us (8201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.348087:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869349.348120:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869349.348135:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8727:x1875765324967680:12345-0@lo:7: 00000100:00100000:1.0:1788869349.350797:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324967552 00000100:00100000:1.0:1788869349.350813:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324967552 00000100:00100000:1.0:1788869349.350873:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869349.350883:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875765324967552:12345-0@lo:13: 00002000:00000024:1.0:1788869349.350922:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1788869349.351016:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875765324967552:12345-0@lo:13: Request processed in 134us (7222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869349.351022:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869349.351078:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2827a5e680 x1875765324967552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869349.351100:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324967552:0@lo:13: 00000004:00080000:1.0:1788869349.351144:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:1.0:1788869349.352416:0:8738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f17b80 x1875765324967296/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869349.352433:0:8738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8738:1875765324967296:0@lo:7: 00000004:00080000:1.0:1788869349.352446:0:8738:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788869349.352487:0:8738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8738:1875765324967808:0@lo:5: 00000100:00100000:1.0:1788869349.352540:0:8738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869349.352577:0:8738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869349.352690:0:8443:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788869349.352703:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324967808 00000100:00100000:2.0:1788869349.352710:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324967808 00000100:00100000:1.0:1788869349.359509:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869349.359527:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8738:x1875765324967808:12345-0@lo:5: 00002000:00080000:1.0:1788869349.359561:0:8743:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788869349.359564:0:8743:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:3.0:1788869349.366679:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788869349.366696:0:8442:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788869349.366801:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8727:x1875765324967680:12345-0@lo:7: Request processed in 18668us (23071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.366814:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788869349.368313:0:8727:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2827a5d500 x1875765324967680/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869349.368331:0:8727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8727:1875765324967680:0@lo:7: 00000004:00080000:1.0:1788869349.368347:0:8727:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788869349.368412:0:8727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8727:1875765324967936:0@lo:5: 00000100:00100000:1.0:1788869349.368471:0:8727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869349.368536:0:8727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.372582:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324967936 00000100:00100000:3.0:1788869349.372623:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324967936 00000100:00100000:3.0:1788869349.372702:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869349.372713:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8727:x1875765324967936:12345-0@lo:5: 00002000:00080000:3.0:1788869349.372752:0:8443:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788869349.372840:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8727:x1875765324967936:12345-0@lo:5: Request processed in 130us (4368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.372848:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788869349.372910:0:8727:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8e680 x1875765324967936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869349.372929:0:8727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8727:1875765324967936:0@lo:5: 00000004:00080000:3.0:1788869349.372944:0:8727:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788869349.372986:0:8727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8727:1875765324968064:0@lo:5: 00000100:00100000:3.0:1788869349.373019:0:8727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.373044:0:8727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28092940c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.373059:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324968064 00000100:00100000:3.0:1788869349.373063:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324968064 00000100:00100000:3.0:1788869349.373090:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869349.373097:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8727:x1875765324968064:12345-0@lo:5: 00002000:00080000:3.0:1788869349.373124:0:8443:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000001:00080000:2.0:1788869349.379877:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788869349.379896:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788869349.379902:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8727:x1875765324968064:12345-0@lo:5: Request processed in 6798us (6874us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788869349.379913:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788869349.380018:0:8727:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f16680 x1875765324968064/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869349.380036:0:8727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8727:1875765324968064:0@lo:5: 00000004:00080000:3.0:1788869349.380052:0:8727:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788869349.380161:0:8727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8727:1875765324968192:0@lo:900: 00000100:00100000:3.0:1788869349.380205:0:8727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869349.380228:0:8727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.380251:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324968192 00000100:00100000:3.0:1788869349.380257:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324968192 00000100:00100000:3.0:1788869349.380692:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869349.380702:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8727:x1875765324968192:12345-0@lo:900: 00000100:00100000:3.0:1788869349.380748:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8727:x1875765324968192:12345-0@lo:900: Request processed in 49us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869349.380755:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788869349.380782:0:8727:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f17b80 x1875765324968192/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869349.380793:0:8727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8727:1875765324968192:0@lo:900: 00000100:00100000:0.0:1788869349.383514:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8738:x1875765324967808:12345-0@lo:5: Request processed in 23983us (30963us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788869349.383531:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788869349.383993:0:8738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8df80 x1875765324967808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869349.384006:0:8738:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788869349.384012:0:8738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8738:1875765324967808:0@lo:5: 00000004:00080000:1.0:1788869349.384025:0:8738:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788869349.384066:0:8738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8738:1875765324968320:0@lo:700: 00000100:00100000:1.0:1788869349.384097:0:8738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869349.384116:0:8738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869349.384219:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324968320 00000100:00100000:3.0:1788869349.384228:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324968320 00000100:00100000:3.0:1788869349.384289:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869349.384301:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8738:x1875765324968320:12345-0@lo:700: 00000001:00080000:3.0:1788869349.402640:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1788869349.402835:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8738:x1875765324968320:12345-0@lo:700: Request processed in 18533us (18733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869349.402852:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788869349.402969:0:8738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8df80 x1875765324968320/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869349.402985:0:8738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8738:1875765324968320:0@lo:700: 00000004:02000040:3.0:1788869349.404413:0:8738:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788869349.411013:0:8738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8738:1875765324968448:0@lo:5: 00000100:00100000:3.0:1788869349.411092:0:8738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869349.411138:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324968448 00000100:00100000:3.0:1788869349.411147:0:8738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869349.411147:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324968448 00000100:00100000:0.0:1788869349.411202:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869349.411212:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8738:x1875765324968448:12345-0@lo:5: 00002000:00080000:0.0:1788869349.415493:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788869349.415513:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788869349.418062:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8738:x1875765324968448:12345-0@lo:5: Request processed in 6844us (6961us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788869349.418084:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788869349.418395:0:8738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f17b80 x1875765324968448/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869365 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869349.418432:0:8738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8738:1875765324968448:0@lo:5: 00000004:00080000:3.0:1788869349.418456:0:8738:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1788869349.574763:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869350.600433:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869350.725846:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869350.725877:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324968576:0@lo:41: 00000100:00100000:0.0:1788869350.725952:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869350.726070:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324968576 00000100:00100000:3.0:1788869350.726079:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324968576 00000100:00100000:3.0:1788869350.726135:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869350.726145:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324968576:12345-0@lo:41: 00000004:00000024:3.0:1788869350.726180:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788869350.726233:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324968576:12345-0@lo:41: Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.726240:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869350.726290:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324968576:0@lo:41: 00000001:02000400:1.0:1788869351.022822:0:8817:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788869351.621986:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869352.231426:0:8869:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869352.234850:0:8869:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869352.649173:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788869353.312944:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1788869353.670496:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869353.798016:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324968704:0@lo:41: 00000100:00100000:0.0:1788869353.798148:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869353.798419:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324968704 00000100:00100000:3.0:1788869353.798429:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324968704 00000100:00100000:3.0:1788869353.798491:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869353.798502:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324968704:12345-0@lo:41: 00000004:00000024:3.0:1788869353.798539:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788869353.798655:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324968704:12345-0@lo:41: Request processed in 155us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869353.798663:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869353.799109:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324968704:0@lo:41: 00010000:00010000:0.0:1788869354.696792:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869354.828472:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324968832:0@lo:13: 00000100:00100000:1.0:1788869354.828556:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.828652:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324968832 00000100:00100000:1.0:1788869354.828660:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324968832 00000100:00100000:1.0:1788869354.828721:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869354.828741:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324968832:12345-0@lo:13: 00002000:00000024:1.0:1788869354.828775:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869354.828821:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324968832:12345-0@lo:13: Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.828828:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788869354.828871:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a0380 x1875765324968832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869354.828881:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788869354.828902:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324968832:0@lo:13: 00000100:00100000:1.0:1788869354.828995:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324968960:0@lo:400: 00000100:00100000:1.0:1788869354.829042:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.829064:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324969472:0@lo:400: 00000100:00100000:1.0:1788869354.829089:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.829109:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788869354.829114:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324969088:0@lo:400: 00000100:00080000:3.0:1788869354.829187:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869354.829203:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.829239:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765324969600:0@lo:400: 00000100:00100000:1.0:1788869354.829266:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.829291:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324969344:0@lo:400: 00000100:00100000:1.0:1788869354.829311:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.829326:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324969856:0@lo:400: 00000100:00100000:1.0:1788869354.829361:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.829379:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788869354.829384:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324969216:0@lo:400: 00000100:00100000:1.0:1788869354.829403:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.829434:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324969728:0@lo:400: 00000100:00100000:1.0:1788869354.829468:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.829502:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324968960 00000100:00100000:1.0:1788869354.829507:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324968960 00000100:00100000:1.0:1788869354.829552:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788869354.829564:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3648:x1875765324968960:12345-0@lo:400: 00000100:00100000:1.0:1788869354.829660:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3648:x1875765324968960:12345-0@lo:400: Request processed in 101us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.829667:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788869354.829694:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324969472 00000100:00100000:1.0:1788869354.829698:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324969472 00000100:00100000:1.0:1788869354.829733:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324969216 00000100:00100000:1.0:1788869354.829737:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324969216 00000100:00100000:1.0:1788869354.829751:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869354.829756:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324969472:12345-0@lo:400: 00000100:00100000:1.0:1788869354.829791:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324969472:12345-0@lo:400: Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.829798:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869354.829812:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869354.829819:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324968960:0@lo:400: 00000100:00100000:1.0:1788869354.829820:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324969216:12345-0@lo:400: 00000100:00100000:3.0:1788869354.829839:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324969472:0@lo:400: 00000100:00100000:1.0:1788869354.829861:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324969216:12345-0@lo:400: Request processed in 43us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.829868:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869354.829887:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324969088 00000100:00100000:1.0:1788869354.829890:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324969088 00000100:00100000:1.0:1788869354.829906:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324969600 00000100:00100000:1.0:1788869354.829909:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324969600 00000100:00100000:1.0:1788869354.829928:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324969344 00000100:00100000:1.0:1788869354.829931:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324969344 00000100:00100000:1.0:1788869354.829939:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324969728 00000100:00100000:1.0:1788869354.829941:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324969728 00000100:00100000:1.0:1788869354.829955:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869354.829961:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324969088:12345-0@lo:400: 00000100:00100000:1.0:1788869354.829990:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324969088:12345-0@lo:400: Request processed in 29us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.829997:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869354.830007:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869354.830013:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765324969600:12345-0@lo:400: 00000100:00100000:1.0:1788869354.830038:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765324969600:12345-0@lo:400: Request processed in 25us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.830050:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869354.830062:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869354.830068:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324969344:12345-0@lo:400: 00000100:00100000:1.0:1788869354.830096:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324969344:12345-0@lo:400: Request processed in 29us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.830102:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869354.830112:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869354.830118:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324969728:12345-0@lo:400: 00000100:00100000:1.0:1788869354.830143:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324969728:12345-0@lo:400: Request processed in 26us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.830148:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869354.830171:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324969856 00000100:00100000:1.0:1788869354.830175:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324969856 00000100:00100000:1.0:1788869354.830212:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869354.830218:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324969856:12345-0@lo:400: 00000100:00100000:1.0:1788869354.830257:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324969856:12345-0@lo:400: Request processed in 39us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.830264:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788869354.830287:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869354.830290:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869354.830293:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869354.830323:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324969216:0@lo:400: 00010000:00080000:1.0:1788869354.830335:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8e680 x1875765324969728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869354.830345:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324969728:0@lo:400: 00010000:00080000:1.0:1788869354.830363:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8ea00 x1875765324969344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869354.830373:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324969344:0@lo:400: 00010000:00080000:1.0:1788869354.830385:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8d180 x1875765324969856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869354.830393:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00010000:00080000:3.0:1788869354.830396:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8f480 x1875765324969088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869354.830405:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324969856:0@lo:400: 00000100:00100000:3.0:1788869354.830410:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324969088:0@lo:400: 00010000:00080000:3.0:1788869354.830426:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8df80 x1875765324969600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869354.830435:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765324969600:0@lo:400: 00000100:00100000:2.0:1788869354.832036:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869354.832058:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324969984:0@lo:13: 00000100:00100000:2.0:1788869354.832518:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.832981:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324969984 00000100:00100000:3.0:1788869354.832990:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324969984 00000100:00100000:3.0:1788869354.833041:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869354.833050:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324969984:12345-0@lo:13: 00002000:00000024:3.0:1788869354.833072:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869354.834026:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324969984:12345-0@lo:13: Request processed in 972us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.834036:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788869354.834425:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da8a680 x1875765324969984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869354.834447:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324969984:0@lo:13: 00000020:00000004:0.0:1788869355.524319:0:8970:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869355.528150:0:8970:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869355.718014:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869355.845797:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324970112:0@lo:41: 00000100:00100000:0.0:1788869355.845931:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869355.846158:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324970112 00000100:00100000:3.0:1788869355.846168:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324970112 00000100:00100000:3.0:1788869355.846230:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869355.846240:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324970112:12345-0@lo:41: 00000004:00000024:3.0:1788869355.846276:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788869355.846366:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324970112:12345-0@lo:41: Request processed in 126us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869355.846374:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788869355.847142:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324970112:0@lo:41: 00000020:00000004:3.0:1788869356.613066:0:9018:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869356.613078:0:9018:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788869356.741719:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869357.766757:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869358.789870:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869358.918957:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324970240:0@lo:41: 00000100:00100000:3.0:1788869358.919042:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869358.919154:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324970240 00000100:00100000:2.0:1788869358.919162:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324970240 00000100:00100000:2.0:1788869358.919243:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869358.919254:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324970240:12345-0@lo:41: 00000004:00000024:2.0:1788869358.919296:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788869358.919356:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324970240:12345-0@lo:41: Request processed in 104us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869358.919364:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869358.919729:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324970240:0@lo:41: 00010000:00010000:0.0:1788869359.813807:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869359.943847:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324970752:0@lo:400: 00000100:00100000:3.0:1788869359.943920:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.943996:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324971264:0@lo:400: 00000100:00100000:3.0:1788869359.944024:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.944059:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788869359.944065:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324970368:0@lo:400: 00000100:00100000:3.0:1788869359.944093:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.944114:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324970880:0@lo:400: 00000100:00100000:3.0:1788869359.944177:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.944197:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324971392:0@lo:400: 00000100:00100000:3.0:1788869359.944219:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.944247:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324970496:0@lo:400: 00000100:00100000:3.0:1788869359.944270:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.944288:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765324971008:0@lo:400: 00000100:00100000:3.0:1788869359.944308:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.944462:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324971520:0@lo:13: 00000100:00100000:3.0:1788869359.944491:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.944515:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788869359.944521:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324970624:0@lo:400: 00000100:00100000:3.0:1788869359.944545:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.944562:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765324971136:0@lo:400: 00000100:00100000:3.0:1788869359.944612:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.944650:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324970752 00000100:00100000:3.0:1788869359.944668:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324970752 00000100:00100000:3.0:1788869359.944707:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324970496 00000100:00100000:3.0:1788869359.944710:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324970496 00000100:00100000:3.0:1788869359.944719:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324971008 00000100:00100000:3.0:1788869359.944721:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324971008 00000100:00100000:3.0:1788869359.944747:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324971136 00000100:00100000:3.0:1788869359.944750:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324971136 00000100:00100000:3.0:1788869359.944765:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869359.944774:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324970752:12345-0@lo:400: 00000100:00100000:3.0:1788869359.944827:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324970752:12345-0@lo:400: Request processed in 54us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869359.944835:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869359.944850:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869359.944855:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324970496:12345-0@lo:400: 00000100:00100000:3.0:1788869359.944884:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324970496:12345-0@lo:400: Request processed in 29us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869359.944889:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869359.944898:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869359.944903:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765324971008:12345-0@lo:400: 00000100:00100000:3.0:1788869359.944926:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765324971008:12345-0@lo:400: Request processed in 23us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869359.944932:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869359.944943:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869359.944948:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765324971136:12345-0@lo:400: 00000100:00100000:3.0:1788869359.944974:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765324971136:12345-0@lo:400: Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869359.944980:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869359.945788:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324971264 00000100:00100000:3.0:1788869359.945802:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324971264 00000100:00100000:3.0:1788869359.945845:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324971392 00000100:00100000:3.0:1788869359.945848:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324971392 00000100:00100000:3.0:1788869359.945876:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869359.945883:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324971264:12345-0@lo:400: 00000100:00100000:3.0:1788869359.945932:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324971264:12345-0@lo:400: Request processed in 49us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869359.945939:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869359.946432:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869359.946443:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324971392:12345-0@lo:400: 00000100:00100000:1.0:1788869359.946484:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324971392:12345-0@lo:400: Request processed in 44us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869359.946489:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869359.946663:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324971520 00000100:00100000:1.0:1788869359.946669:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324971520 00000100:00100000:1.0:1788869359.946700:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869359.946707:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324971520:12345-0@lo:13: 00002000:00000024:1.0:1788869359.946732:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869359.946769:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324971520:12345-0@lo:13: Request processed in 64us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869359.946776:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869359.946824:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324970880 00000100:00100000:1.0:1788869359.946829:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324970880 00000100:00100000:1.0:1788869359.946860:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324970624 00000100:00100000:1.0:1788869359.946864:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324970624 00000100:00100000:1.0:1788869359.946881:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869359.946895:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324970880:12345-0@lo:400: 00000100:00100000:1.0:1788869359.946931:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324970880:12345-0@lo:400: Request processed in 37us (2754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869359.946938:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869359.946968:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869359.946974:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324970624:12345-0@lo:400: 00000100:00100000:1.0:1788869359.947076:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324970624:12345-0@lo:400: Request processed in 101us (2529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869359.947083:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869359.947107:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324970368 00000100:00100000:1.0:1788869359.947111:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324970368 00000100:00100000:1.0:1788869359.947139:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788869359.947145:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3650:x1875765324970368:12345-0@lo:400: 00000100:00100000:1.0:1788869359.947176:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3650:x1875765324970368:12345-0@lo:400: Request processed in 32us (3083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869359.947181:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788869359.948094:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869359.948101:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869359.948103:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869359.948165:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324970624:0@lo:400: 00010000:00080000:3.0:1788869359.948184:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a3480 x1875765324971136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869359.948195:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765324971136:0@lo:400: 00010000:00080000:3.0:1788869359.948208:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a3b80 x1875765324970496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869359.948216:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324970496:0@lo:400: 00010000:00080000:3.0:1788869359.948228:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a0a80 x1875765324971008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869359.948235:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765324971008:0@lo:400: 00010000:00080000:3.0:1788869359.948247:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a3800 x1875765324971520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869359.948263:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324971520:0@lo:13: 00000100:00100000:3.0:1788869359.948305:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324970368:0@lo:400: 00000100:00100000:3.0:1788869359.948647:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324970880:0@lo:400: 00010000:00080000:3.0:1788869359.948664:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a3100 x1875765324971392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869359.948673:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324971392:0@lo:400: 00010000:00080000:3.0:1788869359.948685:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a1c00 x1875765324970752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869359.948694:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324970752:0@lo:400: 00010000:00080000:3.0:1788869359.948704:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a2680 x1875765324971264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869359.948710:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324971264:0@lo:400: 00000100:00100000:3.0:1788869359.948742:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324971648:0@lo:13: 00000100:00100000:3.0:1788869359.948792:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869359.948889:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324971648 00000100:00100000:1.0:1788869359.948895:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324971648 00000100:00100000:1.0:1788869359.948936:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869359.948955:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324971648:12345-0@lo:13: 00002000:00000024:1.0:1788869359.948978:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869359.949146:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324971648:12345-0@lo:13: Request processed in 202us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869359.949154:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788869359.949238:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da8bb80 x1875765324971648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869359.949251:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324971648:0@lo:13: 00010000:00010000:2.0:1788869360.839340:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869360.972634:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324971776:0@lo:41: 00000100:00100000:2.0:1788869360.972722:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869360.973330:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324971776 00000100:00100000:3.0:1788869360.973341:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324971776 00000100:00100000:3.0:1788869360.973406:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869360.973415:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324971776:12345-0@lo:41: 00000004:00000024:3.0:1788869360.973456:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788869360.973524:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324971776:12345-0@lo:41: Request processed in 110us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869360.973531:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869360.974098:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324971776:0@lo:41: 00010000:00010000:2.0:1788869361.862535:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869362.885784:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869363.909816:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869364.041530:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869364.041559:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324971904:0@lo:41: 00000100:00100000:2.0:1788869364.041662:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869364.041741:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324971904 00000100:00100000:2.0:1788869364.041762:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324971904 00000100:00100000:2.0:1788869364.041813:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869364.041823:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324971904:12345-0@lo:41: 00000004:00000024:2.0:1788869364.041864:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788869364.041913:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324971904:12345-0@lo:41: Request processed in 92us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869364.041920:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869364.041969:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324971904:0@lo:41: 00010000:00010000:2.0:1788869364.937659:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869365.062010:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869365.062076:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324972032:0@lo:13: 00000100:00100000:1.0:1788869365.062161:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869365.062347:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324972032 00000100:00100000:2.0:1788869365.062360:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324972032 00000100:00100000:2.0:1788869365.062450:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869365.062461:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324972032:12345-0@lo:13: 00002000:00000024:2.0:1788869365.062498:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869365.062550:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324972032:12345-0@lo:13: Request processed in 91us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869365.062557:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788869365.062629:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da8bb80 x1875765324972032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869365.062647:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324972032:0@lo:13: 00000100:00100000:3.0:1788869365.062848:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869365.062858:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324972160:0@lo:400: 00000100:00100000:3.0:1788869365.062890:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.062930:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869365.062946:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324972288:0@lo:400: 00000100:00100000:3.0:1788869365.062997:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.063023:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324972288 00000100:00100000:3.0:1788869365.063027:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324972288 00000100:00100000:3.0:1788869365.063057:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869365.063063:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324972288:12345-0@lo:400: 00000100:00100000:3.0:1788869365.063097:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324972288:12345-0@lo:400: Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.063103:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788869365.063127:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8ed80 x1875765324972288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869365.063138:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324972288:0@lo:400: 00000100:00100000:3.0:1788869365.063169:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324972416:0@lo:400: 00000100:00100000:3.0:1788869365.063193:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.063231:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324972544:0@lo:400: 00000100:00100000:3.0:1788869365.063253:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.063295:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869365.063303:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324972672:0@lo:400: 00000100:00100000:3.0:1788869365.063324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.063371:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324973056:0@lo:400: 00000100:00100000:3.0:1788869365.063394:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788869365.063506:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869365.063519:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324972544 00000100:00100000:1.0:1788869365.063523:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324972544 00000100:00100000:1.0:1788869365.063553:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869365.063559:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324972544:12345-0@lo:400: 00000100:00100000:1.0:1788869365.063614:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324972544:12345-0@lo:400: Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869365.063620:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869365.063657:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324973056 00000100:00100000:1.0:1788869365.063661:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324973056 00000100:00100000:1.0:1788869365.063690:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869365.063697:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324973056:12345-0@lo:400: 00000100:00100000:1.0:1788869365.063726:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324973056:12345-0@lo:400: Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869365.063732:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788869365.063753:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869365.063768:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a3800 x1875765324973056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869365.063778:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324973056:0@lo:400: 00010000:00080000:1.0:1788869365.063787:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2840f8ea00 x1875765324972544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869365.063794:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324972544:0@lo:400: 00000100:00100000:3.0:1788869365.063951:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324972928:0@lo:400: 00000100:00100000:3.0:1788869365.063978:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.063996:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869365.064001:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765324972800:0@lo:400: 00000100:00100000:3.0:1788869365.064021:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.064053:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324972928 00000100:00100000:3.0:1788869365.064056:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324972928 00000100:00100000:3.0:1788869365.064078:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324972800 00000100:00100000:3.0:1788869365.064081:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324972800 00000100:00100000:3.0:1788869365.064098:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869365.064104:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324972928:12345-0@lo:400: 00000100:00100000:3.0:1788869365.064136:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324972928:12345-0@lo:400: Request processed in 32us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.064142:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869365.064153:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869365.064159:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765324972800:12345-0@lo:400: 00000100:00100000:3.0:1788869365.064183:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765324972800:12345-0@lo:400: Request processed in 25us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.064189:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788869365.064211:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a0000 x1875765324972800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869365.064220:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765324972800:0@lo:400: 00010000:00080000:3.0:1788869365.064231:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a1500 x1875765324972928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869365.064239:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324972928:0@lo:400: 00000100:00100000:2.0:1788869365.064442:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324972160 00000100:00100000:2.0:1788869365.064447:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324972160 00000100:00100000:2.0:1788869365.064482:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788869365.064491:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3648:x1875765324972160:12345-0@lo:400: 00000100:00100000:2.0:1788869365.064526:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3648:x1875765324972160:12345-0@lo:400: Request processed in 37us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869365.064531:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788869365.064572:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324972416 00000100:00100000:2.0:1788869365.064576:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324972416 00000100:00100000:2.0:1788869365.064619:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324972672 00000100:00100000:2.0:1788869365.064622:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324972672 00000100:00100000:2.0:1788869365.064637:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869365.064643:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324972416:12345-0@lo:400: 00000100:00100000:2.0:1788869365.064682:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324972416:12345-0@lo:400: Request processed in 39us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869365.064688:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869365.064700:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788869365.064706:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324972672:12345-0@lo:400: 00000100:00100000:2.0:1788869365.064731:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324972672:12345-0@lo:400: Request processed in 26us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869365.064737:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788869365.064760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324973184:0@lo:13: 00000100:00100000:2.0:1788869365.064786:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869365.064814:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324973184 00000100:00100000:2.0:1788869365.064817:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324973184 00000100:00100000:2.0:1788869365.064838:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869365.064844:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324973184:12345-0@lo:13: 00002000:00000024:2.0:1788869365.064858:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869365.064893:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324973184:12345-0@lo:13: Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869365.064898:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788869365.064922:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2817950000 x1875765324973184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869365.064936:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324973184:0@lo:13: 00000100:00100000:2.0:1788869365.064973:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324972416:0@lo:400: 00000100:00080000:1.0:1788869365.065226:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869365.065231:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869365.065310:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324972672:0@lo:400: 00000100:00100000:3.0:1788869365.065320:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324972160:0@lo:400: 00010000:00010000:0.0:1788869365.959237:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869366.085981:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324973312:0@lo:41: 00000100:00100000:2.0:1788869366.086075:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869366.086222:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324973312 00000100:00100000:3.0:1788869366.086232:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324973312 00000100:00100000:3.0:1788869366.086299:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788869366.086309:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324973312:12345-0@lo:41: 00000004:00000024:3.0:1788869366.086371:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788869366.086468:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324973312:12345-0@lo:41: Request processed in 160us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869366.086475:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869366.086656:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324973312:0@lo:41: 00000020:01000004:2.0:1788869366.787855:0:9518:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788869366.787859:0:9518:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788869366.787860:0:9518:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788869366.788000:0:9518:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e27029d7800 00000020:01000004:2.0:1788869366.788017:0:9518:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788869366.788032:0:9518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788869366.788047:0:9518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e2840d819c0) 00000020:00000080:2.0:1788869366.788067:0:9518:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788869366.850435:0:9518:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788869366.850520:0:9518:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788869366.888111:0:9518:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788869366.888349:0:9518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788869366.888362:0:9518:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788869366.888374:0:9518:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4c16c38a9b6ce723 00000020:01000004:3.0:1788869366.888381:0:9518:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788869366.888404:0:9518:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788869366.888408:0:9518:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788869366.888414:0:9518:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788869366.888443:0:9518:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788869366.888448:0:9518:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788869366.949067:0:9518:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788869366.949112:0:9518:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788869366.949116:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788869366.949118:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869366.949120:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869366.949121:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869366.949122:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869366.949123:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869366.949125:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869366.949126:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869366.949128:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869366.949129:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869366.949131:0:9518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869366.949135:0:9518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788869366.949137:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869366.949138:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869366.949139:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869366.949141:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869366.949142:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869366.949143:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869366.949148:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869366.949149:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869366.949150:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869366.949151:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869366.949152:0:9518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869366.949193:0:9518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788869366.949215:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324973440:0@lo:253: 00000100:00100000:3.0:1788869366.949305:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869366.949361:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869366.951292:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324973440 00000100:00100000:1.0:1788869366.951311:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324973440 00000100:00100000:1.0:1788869366.951387:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788869366.951397:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:9518:x1875765324973440:12345-0@lo:253: 20000000:01000000:1.0:1788869366.951436:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788869366.951440:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788869366.951445:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788869366.951448:0:6518:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788869366.951777:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869366.952145:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788869366.952162:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788869366.952183:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788869366.952207:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788869366.952222:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788869366.952240:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788869366.952351:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788869366.952366:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:1.0:1788869366.952368:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788869366.952385:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788869366.952392:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788869366.952407:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788869366.952413:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:1.0:1788869366.952424:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788869366.952431:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788869366.952443:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788869366.952459:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788869366.952533:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788869366.952542:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:1.0:1788869366.952545:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788869366.952557:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788869366.952562:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788869366.952577:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788869366.952582:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1788869366.952770:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788869366.952780:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788869366.952795:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788869366.952811:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788869366.953333:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1788869366.953348:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:2.0:1788869366.953350:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1788869366.953363:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788869366.953370:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788869366.953382:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788869366.953387:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1788869366.953399:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788869366.953405:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788869366.953417:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788869366.953431:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788869366.953444:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788869366.953447:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788869366.953457:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788869366.953502:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788869366.953505:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788869366.954137:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1788869366.954162:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1788869366.954178:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788869366.954372:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788869366.954391:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788869366.954404:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1788869366.954414:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788869366.954416:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788869366.954695:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788869366.954712:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788869366.954727:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788869366.954870:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788869366.954887:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788869366.954900:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1788869366.954980:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788869366.954983:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788869366.955340:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788869366.955380:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788869366.955391:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788869366.955545:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788869366.955568:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788869366.955739:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1788869366.955757:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788869366.955760:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788869366.956156:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788869366.956176:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788869366.956191:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788869366.956337:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788869366.956354:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788869366.956367:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788869366.956376:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788869366.956378:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788869366.956730:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788869366.956877:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788869366.956898:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788869366.956994:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:2.0:1788869366.957091:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788869366.957112:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957133:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce619 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957141:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce643 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957154:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce682 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957162:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce69e expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957168:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce6c8 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957175:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce6e4 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957182:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce70e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957190:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957231:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce70e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957258:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce70e expref: 21 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.957274:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817953800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324973568:0@lo:104: 00000100:00100000:2.0:1788869366.957340:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869366.957400:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce6e4 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.957409:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6e4 expref: 21 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.957425:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817952a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324973696:0@lo:104: 00000100:00100000:2.0:1788869366.957447:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869366.958429:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce6c8 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.958443:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6c8 expref: 21 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.958457:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703401880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324973824:0@lo:104: 00000100:00100000:2.0:1788869366.958505:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869366.958781:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce69e expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.958790:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce69e expref: 21 pid: 6519 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.958799:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703401500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324973952:0@lo:104: 00000100:00100000:2.0:1788869366.958820:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869366.958874:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324973568 00000100:00100000:1.0:1788869366.958882:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324973568 00000100:00100000:1.0:1788869366.958983:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324973696 00000100:00100000:1.0:1788869366.958987:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324973696 00000100:00100000:1.0:1788869366.959072:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324973824 00000100:00100000:1.0:1788869366.959076:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324973824 00000100:00100000:1.0:1788869366.959095:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869366.959104:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:6518:x1875765324973568:12345-0@lo:104: 00010000:00010000:1.0:1788869366.959120:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959193:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869366.959199:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:6518:x1875765324973568:12345-0@lo:104: Request processed in 96us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.959206:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869366.959239:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869366.959256:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6518:x1875765324973696:12345-0@lo:104: 00010000:00010000:1.0:1788869366.959278:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959321:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869366.959326:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6518:x1875765324973696:12345-0@lo:104: Request processed in 72us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.959332:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869366.959348:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869366.959354:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6518:x1875765324973824:12345-0@lo:104: 00010000:00010000:1.0:1788869366.959361:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959394:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788869366.959399:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6518:x1875765324973824:12345-0@lo:104: Request processed in 46us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.959404:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1788869366.959423:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788869366.959429:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959437:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869366.959442:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959450:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869366.959459:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869366.959474:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869366.959509:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959516:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869366.959537:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959544:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6ce70e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce715 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959556:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869366.959560:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959566:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda800 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869366.959569:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959575:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869366.959581:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869366.959613:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869366.959627:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959633:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869366.959656:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959663:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce6e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959672:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869366.959675:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959681:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869366.959684:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959690:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869366.959696:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869366.959701:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869366.959715:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959720:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869366.959725:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959731:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6ce6c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.959740:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869366.959746:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869366.959748:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869366.959762:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324974080:0@lo:103: 00000100:00100000:1.0:1788869366.959796:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869366.959835:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324974208:0@lo:103: 00000100:00100000:1.0:1788869366.959858:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869366.959876:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869366.959882:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324974336:0@lo:103: 00000100:00100000:1.0:1788869366.959900:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869366.960052:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869366.960184:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324974080 00000100:00100000:1.0:1788869366.960190:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324974080 00010000:00010000:1.0:1788869366.960212:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce70e expref: 22 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.960229:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324974208 00000100:00100000:1.0:1788869366.960232:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324974208 00010000:00010000:1.0:1788869366.960254:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6e4 expref: 23 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.960265:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324974336 00000100:00100000:1.0:1788869366.960267:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324974336 00010000:00010000:1.0:1788869366.960277:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6c8 expref: 24 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.960288:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869366.960294:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765324974080:12345-0@lo:103: 00010000:00010000:1.0:1788869366.960305:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869366.960311:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce70e expref: 24 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.960333:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce70e expref: 24 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.960350:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869366.960394:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765324974080:12345-0@lo:103: Request processed in 100us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.960401:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869366.960419:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869366.960425:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:3648:x1875765324974208:12345-0@lo:103: 00010000:00010000:1.0:1788869366.960433:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869366.960437:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6e4 expref: 23 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.960445:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6e4 expref: 23 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.960454:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869366.960479:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:3648:x1875765324974208:12345-0@lo:103: Request processed in 55us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.960485:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869366.960498:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869366.960504:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3648:x1875765324974336:12345-0@lo:103: 00010000:00010000:1.0:1788869366.960511:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869366.960516:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6c8 expref: 22 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.960524:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6c8 expref: 22 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.960539:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869366.960561:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3648:x1875765324974336:12345-0@lo:103: Request processed in 58us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.960567:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869366.960619:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324974336:0@lo:103: 00000100:00100000:1.0:1788869366.960628:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324974208:0@lo:103: 00010000:00010000:2.0:1788869366.960740:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869366.960784:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce682 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.960795:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce682 expref: 21 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.960804:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703401180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324974464:0@lo:104: 00000100:00100000:2.0:1788869366.960833:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869366.960848:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce643 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.960865:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce643 expref: 21 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.960873:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703400000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324974592:0@lo:104: 00000100:00100000:2.0:1788869366.960898:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869366.960927:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce619 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.960936:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce619 expref: 21 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.960945:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703400a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324974720:0@lo:104: 00000100:00100000:2.0:1788869366.960963:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28268843c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788869366.960975:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce70e expref: 21 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.960985:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817953800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324973568:0@lo:104: 00010000:00010000:2.0:1788869366.960994:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7e600/0x4c16c38a9b6ce6eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6e4 expref: 20 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.961016:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817952a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324973696:0@lo:104: 00010000:00010000:2.0:1788869366.961026:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6ce6cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6c8 expref: 19 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.961033:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703401880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324973824:0@lo:104: 00000100:00100000:1.0:1788869366.961196:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788869366.961213:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869366.961224:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324973952 00000100:00100000:1.0:1788869366.961228:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324973952 00000100:00100000:1.0:1788869366.961261:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324974464 00000100:00100000:1.0:1788869366.961264:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324974464 00000100:00100000:1.0:1788869366.961273:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324974592 00000100:00100000:1.0:1788869366.961275:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324974592 00000100:00100000:1.0:1788869366.961282:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324974720 00000100:00100000:1.0:1788869366.961284:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324974720 00000100:00100000:1.0:1788869366.961293:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869366.961299:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:6518:x1875765324973952:12345-0@lo:104: 00010000:00010000:1.0:1788869366.961310:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961360:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869366.961366:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:6518:x1875765324973952:12345-0@lo:104: Request processed in 67us (2545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.961372:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869366.961388:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869366.961393:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:6518:x1875765324974464:12345-0@lo:104: 00010000:00010000:1.0:1788869366.961407:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961452:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869366.961458:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:6518:x1875765324974464:12345-0@lo:104: Request processed in 65us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.961463:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869366.961479:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869366.961484:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702881850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6518:x1875765324974592:12345-0@lo:104: 00010000:00010000:1.0:1788869366.961491:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961521:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788869366.961527:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702881850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6518:x1875765324974592:12345-0@lo:104: Request processed in 43us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.961532:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869366.961562:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869366.961568:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6518:x1875765324974720:12345-0@lo:104: 00010000:00010000:1.0:1788869366.961575:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961632:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788869366.961638:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6518:x1875765324974720:12345-0@lo:104: Request processed in 71us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.961643:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788869366.961660:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788869366.961665:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961678:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869366.961682:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961690:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869366.961697:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869366.961703:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869366.961725:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961731:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869366.961745:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961751:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6ce69e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961762:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788869366.961765:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961770:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ea00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869366.961773:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961791:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869366.961797:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869366.961802:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869366.961815:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961822:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869366.961828:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961834:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ea00/0x4c16c38a9b6ce682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce689 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961843:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869366.961846:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961851:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869366.961854:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961860:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869366.961866:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869366.961877:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869366.961890:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.961896:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788869366.962021:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324974976:0@lo:103: 00000100:00100000:3.0:1788869366.962059:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869366.962092:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324974080:0@lo:103: 00000100:00100000:3.0:1788869366.962112:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869366.962118:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324974848:0@lo:103: 00000100:00100000:3.0:1788869366.962139:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869366.962275:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869366.962280:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962293:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ec00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869366.962296:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962303:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869366.962309:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869366.962315:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869366.962338:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962344:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869366.962350:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962356:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ec00/0x4c16c38a9b6ce619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce620 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962366:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869366.962368:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869366.962369:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869366.962384:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324975232:0@lo:103: 00000100:00100000:2.0:1788869366.962407:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869366.962421:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869366.962425:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324975104:0@lo:103: 00000100:00100000:2.0:1788869366.962449:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869366.962465:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324974976 00000100:00100000:2.0:1788869366.962470:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324974976 00010000:00010000:2.0:1788869366.962487:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce682 expref: 19 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.962501:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324974848 00000100:00100000:2.0:1788869366.962503:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324974848 00010000:00010000:2.0:1788869366.962511:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce69e expref: 20 pid: 6519 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.962520:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324975232 00000100:00100000:2.0:1788869366.962522:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324975232 00010000:00010000:2.0:1788869366.962530:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce619 expref: 21 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.962537:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324975104 00000100:00100000:2.0:1788869366.962539:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324975104 00010000:00010000:2.0:1788869366.962546:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce643 expref: 22 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.962555:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869366.962561:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3651:x1875765324974976:12345-0@lo:103: 00010000:00010000:2.0:1788869366.962570:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869366.962575:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce682 expref: 22 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962583:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce682 expref: 22 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962619:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869366.962655:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3651:x1875765324974976:12345-0@lo:103: Request processed in 95us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.962661:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869366.962709:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869366.962715:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3651:x1875765324974848:12345-0@lo:103: 00010000:00010000:2.0:1788869366.962722:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869366.962726:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce69e expref: 21 pid: 6519 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962735:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce69e expref: 21 pid: 6519 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962744:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869366.962765:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3651:x1875765324974848:12345-0@lo:103: Request processed in 50us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.962771:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869366.962783:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869366.962789:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703402680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3649:x1875765324975232:12345-0@lo:103: 00010000:00010000:2.0:1788869366.962805:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869366.962809:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce619 expref: 20 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962817:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce619 expref: 20 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962826:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869366.962851:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703402680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3649:x1875765324975232:12345-0@lo:103: Request processed in 62us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.962857:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869366.962874:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869366.962879:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:3649:x1875765324975104:12345-0@lo:103: 00010000:00010000:2.0:1788869366.962886:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869366.962890:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce643 expref: 19 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.962898:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce643 expref: 19 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869366.963029:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324974848:0@lo:103: 00000100:00100000:3.0:1788869366.963038:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324974976:0@lo:103: 00010000:00010000:1.0:1788869366.963147:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.963155:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce64a expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.963177:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869366.963179:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869366.963181:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869366.963195:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869366.963219:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.963230:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.963254:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.963261:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.963267:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.963273:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.963279:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869366.963283:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.963291:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.963307:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.963316:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869366.964079:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:3649:x1875765324975104:12345-0@lo:103: Request processed in 1196us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.964088:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869366.964127:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324975104:0@lo:103: 00000100:00100000:2.0:1788869366.964136:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324975232:0@lo:103: 00010000:00010000:2.0:1788869366.964171:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6200/0x4c16c38a9b6ce6a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce69e expref: 18 pid: 6519 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.964184:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703401500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324973952:0@lo:104: 00010000:00010000:2.0:1788869366.964194:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6ce689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce682 expref: 17 pid: 6516 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.964201:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703401180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324974464:0@lo:104: 00010000:00010000:2.0:1788869366.964209:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce64a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce643 expref: 16 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.964216:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703400000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324974592:0@lo:104: 00010000:00010000:2.0:1788869366.964224:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2800030e00/0x4c16c38a9b6ce620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce619 expref: 15 pid: 6518 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.964232:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703400a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875765324974720:0@lo:104: 00010000:00010000:2.0:1788869366.964267:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.964284:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.964290:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.964296:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce72a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869366.964309:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788869366.970572:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:9518:x1875765324973440:12345-0@lo:253: Request processed in 19163us (21253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.970607:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788869366.970795:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324973440:0@lo:253: 10000000:01000000:3.0:1788869366.970819:0:9518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788869366.970833:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869366.970836:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869366.970838:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869366.970840:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788869366.970843:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869366.970844:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869366.970846:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869366.970848:0:9518:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788869366.970850:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869366.970851:0:9518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788869366.971030:0:9518:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e27029d7800 from lustre-OST0001 10000000:01000000:3.0:1788869366.971080:0:9518:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788869366.971083:0:9518:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788869366.971093:0:9518:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e282a933380 local copy 10000000:01000000:3.0:1788869366.971098:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788869366.971143:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.971156:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.971166:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869366.971191:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975360:0@lo:101: 00000100:00100000:3.0:1788869366.972166:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869366.972351:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324975360 00000100:00100000:0.0:1788869366.972360:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324975360 00000100:00100000:0.0:1788869366.972412:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788869366.972421:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+14:9518:x1875765324975360:12345-0@lo:101: 00010000:00010000:0.0:1788869366.972436:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869366.972459:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce731 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869366.972463:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788869366.972490:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce731 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869366.972501:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce731 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869366.972510:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030000, rc 0) 00000100:00100000:0.0:1788869366.972562:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:9518:x1875765324975360:12345-0@lo:101: Request processed in 142us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869366.972568:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788869366.972742:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975360:0@lo:101: 00010000:00010000:3.0:1788869366.972756:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.972767:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869366.973154:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975488:0@lo:501: 00000100:00100000:3.0:1788869366.973190:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869366.973219:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869366.973500:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324975488 00000100:00100000:2.0:1788869366.973508:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324975488 00000100:00100000:2.0:1788869366.973546:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788869366.973554:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:9518:x1875765324975488:12345-0@lo:501: 00000100:00100000:2.0:1788869366.973659:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:9518:x1875765324975488:12345-0@lo:501: Request processed in 106us (469us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869366.973666:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788869366.973748:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975488:0@lo:501: 10000000:01000000:3.0:1788869366.973762:0:9518:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788869366.973782:0:9518:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788869366.973796:0:9518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.973806:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.973813:0:9518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.973901:0:9518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788869366.973941:0:9518:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e27029d7800 10000000:01000000:3.0:1788869366.973947:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788869366.973953:0:9518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788869366.973956:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869366.973960:0:9518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788869366.973963:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788869366.973984:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.973992:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.973999:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869366.974011:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975616:0@lo:101: 00000100:00100000:3.0:1788869366.974038:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869366.974064:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788869366.974420:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324975616 00000100:00100000:0.0:1788869366.974427:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324975616 00000100:00100000:0.0:1788869366.974469:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788869366.974477:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:9518:x1875765324975616:12345-0@lo:101: 00010000:00010000:0.0:1788869366.974489:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869366.974502:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce73f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869366.974522:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce73f expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869366.974532:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce73f expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869366.974540:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030800, rc 0) 00000100:00100000:0.0:1788869366.974583:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324975616:12345-0@lo:101: Request processed in 107us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869366.974638:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788869366.974680:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975616:0@lo:101: 00010000:00010000:0.0:1788869366.974693:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869366.974700:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869366.974778:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975744:0@lo:501: 00000100:00100000:0.0:1788869366.974804:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869366.974825:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324975744 00000100:00100000:0.0:1788869366.974829:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324975744 00000100:00100000:0.0:1788869366.974845:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788869366.974850:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324975744:12345-0@lo:501: 00000100:00100000:0.0:1788869366.974953:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324975744:12345-0@lo:501: Request processed in 102us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869366.974960:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788869366.974982:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27026070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869366.974994:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975744:0@lo:501: 00000100:00100000:0.0:1788869366.975269:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975872:0@lo:503: 00000100:00100000:0.0:1788869366.975311:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869366.975335:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324975872 00000100:00100000:0.0:1788869366.975339:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324975872 00000100:00100000:0.0:1788869366.975357:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788869366.975363:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324975872:12345-0@lo:503: 00000100:00100000:0.0:1788869366.975581:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324975872:12345-0@lo:503: Request processed in 217us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869366.975612:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788869366.976292:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27026070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869366.976311:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324975872:0@lo:503: 00010000:00010000:2.0:1788869366.977414:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869366.977430:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.977443:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869366.977448:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.977475:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869366.977482:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869366.977488:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869366.977523:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.977530:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869366.977556:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.977564:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6ce731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4c16c38a9b6ce738 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.977580:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869366.977582:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869366.977584:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869366.977608:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869366.977626:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324976000:0@lo:103: 00000100:00100000:2.0:1788869366.977684:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869366.978780:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324976000 00000100:00100000:2.0:1788869366.978791:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324976000 00000100:00100000:2.0:1788869366.979136:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869366.979149:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:3651:x1875765324976000:12345-0@lo:103: 00010000:00010000:2.0:1788869366.979164:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869366.979181:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce731 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.979206:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:0.0:1788869366.979238:0:9518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869366.979328:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976128:0@lo:502: 00000100:00100000:0.0:1788869366.979393:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869366.979434:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324976128 00000100:00100000:0.0:1788869366.979439:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324976128 00000100:00100000:0.0:1788869366.979472:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788869366.979478:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976128:12345-0@lo:502: 00000100:00100000:0.0:1788869366.979580:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976128:12345-0@lo:502: Request processed in 101us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869366.979601:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788869366.980407:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:3651:x1875765324976000:12345-0@lo:103: Request processed in 1258us (2718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.980416:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869366.980667:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324976000:0@lo:103: 00000100:00100000:0.0:1788869366.981131:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27026070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869366.981146:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976128:0@lo:502: 00000040:00080000:0.0:1788869366.981438:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788869366.981468:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788869366.981483:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788869366.981495:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788869366.981507:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788869366.981523:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788869366.981554:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976256:0@lo:502: 00000100:00100000:0.0:1788869366.981620:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869366.981649:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27026070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869366.981723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324976256 00000100:00100000:2.0:1788869366.981731:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324976256 00000100:00100000:2.0:1788869366.981784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788869366.981793:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:9518:x1875765324976256:12345-0@lo:502: 00000100:00100000:2.0:1788869366.981933:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:9518:x1875765324976256:12345-0@lo:502: Request processed in 141us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.981941:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788869366.982161:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976256:0@lo:502: 00000040:00080000:0.0:1788869366.982198:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00010000:00010000:3.0:1788869366.982386:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869366.983891:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788869366.994105:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869366.994118:0:9529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788869366.994126:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869366.994128:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788869366.994136:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869366.994155:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e27025ecd40) 00000020:00000080:3.0:1788869366.994182:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788869366.994188:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788869366.994272:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e27029d7800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788869366.994291:0:9529:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788869366.994298:0:9529:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4c16c38a9b6ce754 00010000:00010000:3.0:1788869367.006229:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788869367.018135:0:9529:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788869367.021202:0:9529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788869367.022182:0:9529:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788869367.029171:0:9529:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788869367.029389:0:9529:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788869367.042267:0:9529:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788869367.044511:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788869367.044522:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869367.044529:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869367.044532:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788869367.044540:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869367.044544:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869367.044546:0:9529:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869367.044549:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869367.044551:0:9529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788869367.044577:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869367.044580:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869367.044624:0:9529:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788869367.044629:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788869367.045401:0:9518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788869367.045438:0:9518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788869367.045460:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.045474:0:9518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869367.045483:0:9518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e27029d7800 from 1 10000000:01000000:0.0:1788869367.045486:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869367.045530:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.045538:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.045550:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.045574:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976384:0@lo:101: 00000100:00100000:0.0:1788869367.045688:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.045746:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.045828:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324976384 00000100:00100000:1.0:1788869367.045838:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324976384 00000100:00100000:1.0:1788869367.045893:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788869367.045902:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:9518:x1875765324976384:12345-0@lo:101: 00010000:00010000:1.0:1788869367.045926:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869367.045939:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce75b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.045965:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce75b expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.045976:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce75b expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.046001:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e000, rc 0) 00000100:00100000:1.0:1788869367.046050:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976384:12345-0@lo:101: Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.046057:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788869367.046126:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976384:0@lo:101: 00010000:00010000:1.0:1788869367.046140:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.046149:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869367.046266:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976512:0@lo:501: 00000100:00100000:1.0:1788869367.046293:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.046319:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.047397:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324976512 00000100:00100000:2.0:1788869367.047407:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324976512 00000100:00100000:2.0:1788869367.047453:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788869367.047461:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976512:12345-0@lo:501: 00000100:00100000:2.0:1788869367.047768:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976512:12345-0@lo:501: Request processed in 124us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.047778:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788869367.047925:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976512:0@lo:501: 00000100:00100000:0.0:1788869367.047978:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976640:0@lo:503: 00000100:00100000:0.0:1788869367.048145:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.048177:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27026076c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.048497:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324976640 00000100:00100000:1.0:1788869367.048504:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324976640 00000100:00100000:1.0:1788869367.048543:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788869367.048552:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976640:12345-0@lo:503: 00000100:00100000:1.0:1788869367.048676:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976640:12345-0@lo:503: Request processed in 124us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.048684:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788869367.049181:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976640:0@lo:503: 00000040:00080000:0.0:1788869367.049481:0:9518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869367.049562:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976768:0@lo:502: 00000100:00100000:0.0:1788869367.049626:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.049662:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27026076c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.049804:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324976768 00000100:00100000:1.0:1788869367.049810:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324976768 00000100:00100000:1.0:1788869367.049853:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788869367.049860:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976768:12345-0@lo:502: 00000100:00100000:1.0:1788869367.049981:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976768:12345-0@lo:502: Request processed in 120us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.049995:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788869367.051289:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976768:0@lo:502: 00000040:00080000:0.0:1788869367.051535:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788869367.051569:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788869367.051631:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976896:0@lo:502: 00000100:00100000:0.0:1788869367.051692:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.052042:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27026076c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.052263:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324976896 00000100:00100000:1.0:1788869367.052272:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324976896 00000100:00100000:1.0:1788869367.052319:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788869367.052328:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976896:12345-0@lo:502: 00000100:00100000:1.0:1788869367.052448:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324976896:12345-0@lo:502: Request processed in 120us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.052456:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788869367.053166:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324976896:0@lo:502: 00000040:00080000:0.0:1788869367.053260:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788869367.053272:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788869367.060644:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869367.060658:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869367.060660:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788869367.060668:0:9532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e27029d7800 00000020:00000080:1.0:1788869367.060670:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869367.060700:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869367.060704:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869367.060705:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788869367.060708:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788869367.062076:0:9518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788869367.062117:0:9518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869367.062138:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.062164:0:9518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869367.062234:0:9518:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788869367.062237:0:9518:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e27029d7800 10000000:01000000:0.0:1788869367.062251:0:9518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e27029d7800 10000000:01000000:0.0:1788869367.062257:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869367.062263:0:9518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e27029d7800 from 1 10000000:01000000:0.0:1788869367.062266:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869367.062304:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.062326:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.062339:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.062364:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977024:0@lo:101: 00000100:00100000:0.0:1788869367.062435:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.062496:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.064378:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324977024 00000100:00100000:1.0:1788869367.064394:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324977024 00000100:00100000:1.0:1788869367.064477:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788869367.064489:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9518:x1875765324977024:12345-0@lo:101: 00010000:00010000:1.0:1788869367.064506:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869367.064524:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce769 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.064552:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce769 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.064564:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce769 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.064582:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ea00, rc 0) 00000100:00100000:1.0:1788869367.064681:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324977024:12345-0@lo:101: Request processed in 194us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.064689:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788869367.064732:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977024:0@lo:101: 00010000:00010000:0.0:1788869367.064751:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.064763:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.064875:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977152:0@lo:501: 00000100:00100000:0.0:1788869367.064912:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.065872:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.066357:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324977152 00000100:00100000:1.0:1788869367.066366:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324977152 00000100:00100000:2.0:1788869367.066491:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788869367.066503:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324977152:12345-0@lo:501: 00000100:00100000:2.0:1788869367.066683:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324977152:12345-0@lo:501: Request processed in 183us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.066692:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788869367.069174:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977152:0@lo:501: 00000100:00100000:0.0:1788869367.069252:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977280:0@lo:503: 00000100:00100000:0.0:1788869367.069333:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.069376:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.069410:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324977280 00000100:00100000:2.0:1788869367.069417:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324977280 00000100:00100000:2.0:1788869367.069570:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788869367.069580:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324977280:12345-0@lo:503: 00000100:00100000:2.0:1788869367.069763:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324977280:12345-0@lo:503: Request processed in 184us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.069770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788869367.070249:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977280:0@lo:503: 00000040:00080000:0.0:1788869367.070509:0:9518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869367.070623:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977408:0@lo:502: 00000100:00100000:0.0:1788869367.070672:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.070699:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.071881:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324977408 00000100:00100000:2.0:1788869367.071893:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324977408 00000100:00100000:2.0:1788869367.071940:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788869367.071949:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324977408:12345-0@lo:502: 00000100:00100000:2.0:1788869367.072188:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324977408:12345-0@lo:502: Request processed in 239us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.072207:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788869367.072582:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977408:0@lo:502: 00000040:00080000:0.0:1788869367.072861:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788869367.072902:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788869367.072919:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788869367.072931:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788869367.072943:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788869367.072955:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788869367.072967:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788869367.072980:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788869367.072993:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788869367.073006:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788869367.073030:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788869367.073042:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788869367.073053:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788869367.073064:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788869367.073074:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788869367.073085:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788869367.073096:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788869367.073106:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788869367.073117:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788869367.073128:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788869367.073139:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788869367.073149:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788869367.073160:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788869367.073174:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788869367.073186:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788869367.073198:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788869367.073221:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788869367.073436:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788869367.073465:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788869367.073480:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788869367.073492:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788869367.073504:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788869367.073515:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788869367.073527:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788869367.073538:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788869367.073549:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788869367.073560:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788869367.073572:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788869367.073583:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788869367.073619:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788869367.073631:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788869367.073642:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788869367.073664:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788869367.073677:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788869367.073689:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788869367.073701:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788869367.073737:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977536:0@lo:502: 00000100:00100000:0.0:1788869367.073802:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.074081:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.074262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324977536 00000100:00100000:2.0:1788869367.074271:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324977536 00000100:00100000:2.0:1788869367.074313:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788869367.074321:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324977536:12345-0@lo:502: 00000100:00100000:2.0:1788869367.074434:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324977536:12345-0@lo:502: Request processed in 113us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.074441:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788869367.074697:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324977536:0@lo:502: 00000040:00080000:0.0:1788869367.074756:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788869367.074768:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788869367.076685:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788869367.076711:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e2840a3cd40) 00000020:00000080:0.0:1788869367.076736:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788869367.076841:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e27029d7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788869367.076845:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e27029d7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788869367.076847:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e27029d7800 3 00010000:00080000:0.0:1788869367.076887:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e27036c3000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1788869367.078465:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788869367.078706:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788869367.078746:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788869367.078759:0:9534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4c16c38a9b6ce77e 00000100:00080000:0.0:1788869367.078770:0:9534:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869367.078781:0:9534:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e27036c3000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869367.078820:0:9534:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282da8b100 x1875765324977664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869367.078848:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788869367.081205:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324977792:0@lo:400: 00000100:00100000:2.0:1788869367.081297:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.081335:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765324978304:0@lo:400: 00000100:00100000:2.0:1788869367.081358:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.081382:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788869367.081387:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324978176:0@lo:400: 00000100:00100000:2.0:1788869367.081412:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.081430:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324978688:0@lo:400: 00000100:00100000:2.0:1788869367.081453:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.081485:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765324978048:0@lo:400: 00000100:00100000:2.0:1788869367.081506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.081521:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324978560:0@lo:400: 00000100:00100000:2.0:1788869367.081541:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.081560:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788869367.081565:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324977920:0@lo:400: 00000100:00100000:2.0:1788869367.081605:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.081621:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765324978432:0@lo:400: 00000100:00100000:2.0:1788869367.081660:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.081689:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324977792 00000100:00100000:2.0:1788869367.081707:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324977792 00000100:00100000:2.0:1788869367.081752:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324978304 00000100:00100000:2.0:1788869367.081757:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324978304 00000100:00100000:2.0:1788869367.081783:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324978048 00000100:00100000:2.0:1788869367.081785:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324978048 00000100:00100000:2.0:1788869367.081796:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324978432 00000100:00100000:2.0:1788869367.081798:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324978432 00000100:00100000:2.0:1788869367.081813:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869367.081833:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324977792:12345-0@lo:400: 00000100:00100000:2.0:1788869367.081887:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324977792:12345-0@lo:400: Request processed in 65us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.081894:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869367.081911:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869367.081917:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765324978304:12345-0@lo:400: 00000100:00100000:2.0:1788869367.081943:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765324978304:12345-0@lo:400: Request processed in 27us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.081948:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869367.081959:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869367.081964:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765324978048:12345-0@lo:400: 00000100:00100000:2.0:1788869367.081991:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765324978048:12345-0@lo:400: Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.081997:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869367.082007:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788869367.082012:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765324978432:12345-0@lo:400: 00000100:00100000:2.0:1788869367.082037:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765324978432:12345-0@lo:400: Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.082049:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788869367.082068:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324978176 00000100:00100000:2.0:1788869367.082071:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324978176 00000100:00100000:2.0:1788869367.082092:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324977920 00000100:00100000:2.0:1788869367.082094:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324977920 00000100:00100000:2.0:1788869367.082107:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869367.082113:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324978176:12345-0@lo:400: 00000100:00100000:2.0:1788869367.082142:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324978176:12345-0@lo:400: Request processed in 30us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.082148:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869367.082159:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869367.082164:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324977920:12345-0@lo:400: 00000100:00100000:2.0:1788869367.082191:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324977920:12345-0@lo:400: Request processed in 26us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.082197:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869367.082215:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324978688 00000100:00100000:2.0:1788869367.082218:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324978688 00000100:00100000:2.0:1788869367.082250:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324978560 00000100:00100000:2.0:1788869367.082254:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324978560 00000100:00100000:2.0:1788869367.082273:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869367.082278:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324978688:12345-0@lo:400: 00000100:00100000:2.0:1788869367.082306:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324978688:12345-0@lo:400: Request processed in 28us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.082311:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869367.082322:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869367.082327:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324978560:12345-0@lo:400: 00000100:00100000:2.0:1788869367.082351:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324978560:12345-0@lo:400: Request processed in 24us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.082362:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869367.082407:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324977920:0@lo:400: 00010000:00080000:2.0:1788869367.082420:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703401f80 x1875765324978432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869367.082429:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765324978432:0@lo:400: 00010000:00080000:2.0:1788869367.082438:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703401880 x1875765324978048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869367.082444:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765324978048:0@lo:400: 00010000:00080000:2.0:1788869367.082453:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703400e00 x1875765324978560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869367.082460:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324978560:0@lo:400: 00000100:00100000:2.0:1788869367.082494:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324978176:0@lo:400: 00010000:00080000:2.0:1788869367.082502:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703402d80 x1875765324978688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869367.082509:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324978688:0@lo:400: 00010000:00080000:2.0:1788869367.082518:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703401180 x1875765324977792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869367.082524:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324977792:0@lo:400: 00010000:00080000:2.0:1788869367.082533:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703403800 x1875765324978304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869367.082540:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765324978304:0@lo:400: 00000100:00100000:1.0:1788869367.084098:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765324977664:0@lo:38: 00000100:00100000:1.0:1788869367.084169:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.084259:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324977664 00000100:00100000:1.0:1788869367.084267:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324977664 00000100:00100000:1.0:1788869367.084292:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869367.084298:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765324977664:12345-0@lo:38: 00010000:00080000:1.0:1788869367.084322:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:1.0:1788869367.084355:0:6525:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4c16c38a9b6ce785 00000004:00100000:1.0:1788869367.084369:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869367.084405:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8e2701f18000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869367.084454:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765324977664:12345-0@lo:38: Request processed in 155us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.084462:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788869367.084501:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869367.084506:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869367.084508:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788869367.084553:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da8b100 x1875765324977664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869367.084564:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869367.084571:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788869367.084605:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788869367.084611:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788869367.084613:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27036c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788869367.084620:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765324977664:0@lo:38: 00000020:01000004:1.0:1788869367.086154:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788869367.086171:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8e28411e0000) 00000020:00000080:1.0:1788869367.086193:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788869367.086354:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e27029d7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869367.086359:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e27029d7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869367.086362:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e27029d7800 3 00010000:00080000:1.0:1788869367.086395:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282dac5800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.154@tcp at head 00000100:00100000:0.0:1788869367.087404:0:9535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1875765324978816:0@lo:901: 00000100:00100000:0.0:1788869367.087473:0:9535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.087514:0:9535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.088884:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324978816 00000100:00100000:3.0:1788869367.088896:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324978816 00000100:00100000:3.0:1788869367.088986:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869367.088997:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1875765324978816:12345-0@lo:901: 00000100:00100000:3.0:1788869367.089121:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1875765324978816:12345-0@lo:901: Request processed in 127us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.089129:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788869367.089323:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788869367.089366:0:9535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da88380 x1875765324978816/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788869383 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869367.089382:0:9535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1875765324978816:0@lo:901: 00010000:00010000:1.0:1788869367.098285:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788869367.098526:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788869367.098576:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788869367.098616:0:9534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4c16c38a9b6ce793 00000100:00080000:1.0:1788869367.098627:0:9534:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869367.098641:0:9534:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e282dac5800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869367.098691:0:9534:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282db36680 x1875765324978944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869367.103649:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788869367.105123:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324979200:0@lo:400: 00000100:00100000:1.0:1788869367.105200:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.105237:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765324979712:0@lo:400: 00000100:00100000:1.0:1788869367.105271:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.105288:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765324980224:0@lo:400: 00000100:00100000:1.0:1788869367.105309:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.105346:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788869367.105353:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324979328:0@lo:400: 00000100:00100000:1.0:1788869367.105379:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.105396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765324979840:0@lo:400: 00000100:00100000:1.0:1788869367.105417:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.105460:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324979200 00000100:00100000:1.0:1788869367.105467:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324979200 00000100:00100000:1.0:1788869367.105507:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324979712 00000100:00100000:1.0:1788869367.105510:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324979712 00000100:00100000:1.0:1788869367.105524:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324980224 00000100:00100000:1.0:1788869367.105527:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324980224 00000100:00100000:1.0:1788869367.105539:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324979840 00000100:00100000:1.0:1788869367.105541:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324979840 00000100:00100000:1.0:1788869367.105558:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869367.105567:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324979200:12345-0@lo:400: 00000100:00100000:1.0:1788869367.105654:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765324979200:12345-0@lo:400: Request processed in 87us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.105662:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869367.105707:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869367.105714:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765324979712:12345-0@lo:400: 00000100:00100000:1.0:1788869367.105745:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765324979712:12345-0@lo:400: Request processed in 32us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.105751:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869367.105765:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869367.105772:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765324980224:12345-0@lo:400: 00000100:00100000:1.0:1788869367.105798:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765324980224:12345-0@lo:400: Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.105804:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869367.105848:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869367.105855:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765324979840:12345-0@lo:400: 00000100:00100000:2.0:1788869367.106187:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765324978944:0@lo:38: 00000100:00100000:2.0:1788869367.106226:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.106285:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324979456:0@lo:400: 00000100:00100000:2.0:1788869367.106309:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.106321:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324979968:0@lo:400: 00000100:00100000:2.0:1788869367.106342:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.106362:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788869367.106368:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324979072:0@lo:400: 00000100:00100000:2.0:1788869367.106394:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.106412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324979584:0@lo:400: 00000100:00100000:2.0:1788869367.106432:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.106448:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324980096:0@lo:400: 00000100:00100000:2.0:1788869367.106467:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.106493:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324979072 00000100:00100000:2.0:1788869367.106498:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324979072 00000100:00100000:2.0:1788869367.106532:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788869367.106539:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:3650:x1875765324979072:12345-0@lo:400: 00000100:00100000:2.0:1788869367.106577:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:3650:x1875765324979072:12345-0@lo:400: Request processed in 38us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.106583:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788869367.106629:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324979328 00000100:00100000:2.0:1788869367.106633:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324979328 00000100:00100000:2.0:1788869367.106653:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324979584 00000100:00100000:2.0:1788869367.106656:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324979584 00000100:00100000:2.0:1788869367.106669:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869367.106674:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324979328:12345-0@lo:400: 00000100:00100000:2.0:1788869367.107304:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324979328:12345-0@lo:400: Request processed in 627us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.107313:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869367.107333:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869367.107339:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324979584:12345-0@lo:400: 00000100:00100000:2.0:1788869367.107373:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324979584:12345-0@lo:400: Request processed in 34us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.107379:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869367.107402:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324979968 00000100:00100000:2.0:1788869367.107406:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324979968 00000100:00100000:2.0:1788869367.107445:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324980096 00000100:00100000:2.0:1788869367.107448:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324980096 00000100:00100000:2.0:1788869367.107471:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869367.107479:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324979968:12345-0@lo:400: 00000100:00100000:2.0:1788869367.107510:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324979968:12345-0@lo:400: Request processed in 32us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.107517:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869367.107529:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869367.107536:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324980096:12345-0@lo:400: 00000100:00100000:2.0:1788869367.107562:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324980096:12345-0@lo:400: Request processed in 27us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.107569:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869367.107643:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324979072:0@lo:400: 00000100:00100000:2.0:1788869367.107657:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324979584:0@lo:400: 00010000:00080000:2.0:1788869367.107671:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282db34700 x1875765324980096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869367.110018:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324978944 00000100:00100000:1.0:1788869367.110032:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324978944 00000100:00100000:1.0:1788869367.110063:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324979456 00000100:00100000:1.0:1788869367.110066:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324979456 00000100:00100000:1.0:1788869367.110094:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869367.110105:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324979456:12345-0@lo:400: 00000100:00100000:1.0:1788869367.110192:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324979456:12345-0@lo:400: Request processed in 89us (3880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.110199:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869367.110236:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869367.110251:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875765324978944:12345-0@lo:38: 00010000:00080000:1.0:1788869367.110280:0:8260:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:1.0:1788869367.110341:0:8260:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4c16c38a9b6ce79a 00000004:00100000:1.0:1788869367.110359:0:8260:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869367.110399:0:8260:0:(import.c:65:import_set_state_nolock()) ffff8e283dfed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869367.110460:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765324978944:12345-0@lo:38: Request processed in 207us (4233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.110467:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869367.110548:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324979328:0@lo:400: 00010000:00080000:1.0:1788869367.110568:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282db37800 x1875765324979200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869367.110580:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765324979200:0@lo:400: 00010000:00080000:1.0:1788869367.110626:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282db34a80 x1875765324979712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869367.110649:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765324979712:0@lo:400: 00010000:00080000:1.0:1788869367.110667:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282db35500 x1875765324980224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869367.110676:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765324980224:0@lo:400: 00000100:00100000:1.0:1788869367.110787:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765324979840:12345-0@lo:400: Request processed in 4932us (5368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.110795:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788869367.110822:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282db34000 x1875765324979840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869367.110832:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765324979840:0@lo:400: 00010000:00080000:0.0:1788869367.111319:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282db36680 x1875765324978944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869367.111329:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869367.111336:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788869367.111345:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788869367.111351:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788869367.111354:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282dac5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788869367.111360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765324978944:0@lo:38: 00000100:00100000:2.0:1788869367.112052:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324980096:0@lo:400: 00010000:00080000:2.0:1788869367.112251:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282db34e00 x1875765324979456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869367.112263:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324979456:0@lo:400: 00010000:00080000:2.0:1788869367.112278:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282db35c00 x1875765324979968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869367.112286:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324979968:0@lo:400: 00000040:00080000:1.0:1788869367.113379:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1788869367.113442:0:9518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1788869367.113476:0:9518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869367.113491:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.113505:0:9518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788869367.113566:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788869367.113567:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869367.113569:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869367.113570:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869367.113571:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869367.113572:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869367.113574:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869367.113575:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869367.113576:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869367.113581:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869367.113582:0:9518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869367.113608:0:9518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788869367.113610:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869367.113612:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869367.113613:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869367.113614:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869367.113615:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869367.113616:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869367.113617:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869367.113618:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869367.113619:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869367.113620:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869367.113621:0:9518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869367.113658:0:9518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788869367.113676:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817950e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324980352:0@lo:253: 00000100:00100000:1.0:1788869367.113759:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.113794:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324980352 00000100:00100000:1.0:1788869367.113798:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.113804:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324980352 00000100:00100000:3.0:1788869367.113857:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788869367.113868:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324980352:12345-0@lo:253: 20000000:01000000:3.0:1788869367.113898:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788869367.113912:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788869367.122844:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788869367.122868:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788869367.123097:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788869367.123109:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788869367.123131:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.123154:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce690 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.123163:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce6d6 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.123172:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.123223:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce6d6 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.123263:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6d6 expref: 17 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.123289:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324980480:0@lo:104: 00000100:00100000:0.0:1788869367.123382:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869367.123447:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce690 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.123457:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce690 expref: 17 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.123466:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324980608:0@lo:104: 00000100:00100000:0.0:1788869367.123489:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.123519:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.123520:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324980480 00000100:00100000:1.0:1788869367.123530:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324980480 00000100:00100000:1.0:1788869367.123572:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324980608 00000100:00100000:1.0:1788869367.123575:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324980608 00000100:00100000:3.0:1788869367.124635:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9518:x1875765324980352:12345-0@lo:253: Request processed in 10764us (10872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.124648:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869367.124988:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869367.124990:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817950e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9518:1875765324980352:0@lo:253: 00000100:00100000:2.0:1788869367.125005:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6540:x1875765324980480:12345-0@lo:104: 10000000:01000000:3.0:1788869367.125008:0:9518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788869367.125014:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869367.125016:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869367.125018:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869367.125019:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869367.125021:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869367.125022:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:2.0:1788869367.125024:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788869367.125025:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869367.125028:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869367.125030:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869367.125033:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869367.125035:0:9518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788869367.125051:0:9518:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788869367.125107:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869367.125113:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:6540:x1875765324980480:12345-0@lo:104: Request processed in 115us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.125120:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869367.125152:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869367.125157:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6540:x1875765324980608:12345-0@lo:104: 00010000:00010000:2.0:1788869367.125166:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125200:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869367.125205:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:6540:x1875765324980608:12345-0@lo:104: Request processed in 48us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.125219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788869367.125249:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869367.125256:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125263:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800030c00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869367.125267:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125277:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869367.125285:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869367.125291:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869367.125321:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125328:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869367.125345:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125352:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2800030c00/0x4c16c38a9b6ce6d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce6dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125364:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869367.125367:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125382:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7a00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869367.125385:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125391:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869367.125397:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869367.125402:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869367.125413:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125418:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869367.125429:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125435:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28029d7a00/0x4c16c38a9b6ce690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce697 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125456:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869367.125457:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869367.125459:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869367.125476:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324980736:0@lo:103: 00000100:00100000:2.0:1788869367.125505:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.125538:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869367.125544:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324980864:0@lo:103: 00000100:00100000:2.0:1788869367.125568:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.125607:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324980736 00000100:00100000:2.0:1788869367.125612:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324980736 00010000:00010000:2.0:1788869367.125630:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6d6 expref: 17 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869367.125646:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324980864 00000100:00100000:2.0:1788869367.125648:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324980864 00010000:00010000:2.0:1788869367.125656:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce690 expref: 18 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869367.125665:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869367.125670:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:3649:x1875765324980736:12345-0@lo:103: 00010000:00010000:2.0:1788869367.125678:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869367.125683:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6d6 expref: 18 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125705:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6d6 expref: 18 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125720:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869367.125746:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:3649:x1875765324980736:12345-0@lo:103: Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.125751:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869367.125763:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869367.125768:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:3651:x1875765324980864:12345-0@lo:103: 00010000:00010000:2.0:1788869367.125774:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869367.125778:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce690 expref: 17 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125795:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce690 expref: 17 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125807:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125814:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869367.125839:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012655653s 00010000:00010000:2.0:1788869367.125844:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125851:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.125858:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.127182:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.127195:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869367.127199:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.127210:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.127211:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce6dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce6d6 expref: 17 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.127223:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.127262:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324980480:0@lo:104: 00010000:00010000:2.0:1788869367.127269:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869367.127327:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:3651:x1875765324980864:12345-0@lo:103: Request processed in 1556us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.127337:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869367.127382:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324980736:0@lo:103: 00000100:00100000:2.0:1788869367.127412:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765324980864:0@lo:103: 00010000:00010000:2.0:1788869367.127653:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869367.127840:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6ce697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce690 expref: 15 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.127853:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875765324980608:0@lo:104: 00010000:00010000:0.0:1788869367.127869:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.127879:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.127885:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.127890:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce7a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788869367.135690:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788869367.135851:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788869367.137442:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788869367.137708:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788869367.137946:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788869367.138145:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788869367.141503:0:9518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788869367.150050:0:9518:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788869367.150062:0:9518:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788869367.150105:0:9518:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788869367.150172:0:9518:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788869367.150195:0:9518:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788869367.150220:0:9518:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788869367.158738:0:9518:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869367.159133:0:9518:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788869368.009398:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869368.226407:0:9590:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869368.227642:0:9590:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869369.029738:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869369.158760:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869369.158787:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324980992:0@lo:41: 00000100:00100000:1.0:1788869369.158894:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869369.159009:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324980992 00000100:00100000:2.0:1788869369.159017:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324980992 00000100:00100000:2.0:1788869369.159074:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869369.159084:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324980992:12345-0@lo:41: 00000004:00000024:2.0:1788869369.159121:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788869369.159185:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324980992:12345-0@lo:41: Request processed in 103us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869369.159204:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788869369.159289:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324980992:0@lo:41: 00010000:00010000:1.0:1788869370.053816:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869370.182382:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324981120:0@lo:13: 00000100:00100000:3.0:1788869370.182481:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869370.182568:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324981120 00000100:00100000:3.0:1788869370.182576:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324981120 00000100:00100000:3.0:1788869370.182674:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869370.182685:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324981120:12345-0@lo:13: 00002000:00000024:3.0:1788869370.182716:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869370.182776:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324981120:12345-0@lo:13: Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869370.182783:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788869370.182805:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869370.182819:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324981248:0@lo:13: 00000100:00100000:3.0:1788869370.182846:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788869370.182944:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a1180 x1875765324981120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869370.182964:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324981248 00000100:00100000:3.0:1788869370.182965:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324981120:0@lo:13: 00000100:00100000:0.0:1788869370.182968:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324981248 00000100:00080000:3.0:1788869370.182997:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869370.183004:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869370.183010:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324981248:12345-0@lo:13: 00002000:00000024:0.0:1788869370.183021:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869370.183054:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324981248:12345-0@lo:13: Request processed in 44us (208us total) trans 0 rc 0/0 00010000:00080000:3.0:1788869370.183983:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282da8ad80 x1875765324981248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869370.184003:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324981248:0@lo:13: 00000100:00100000:0.0:1788869370.195346:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788869371.079510:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869371.209631:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869371.209660:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324981376:0@lo:41: 00000100:00100000:0.0:1788869371.209739:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869371.212062:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324981376 00000100:00100000:2.0:1788869371.212079:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324981376 00000100:00100000:2.0:1788869371.212132:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869371.212154:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324981376:12345-0@lo:41: 00000004:00000024:2.0:1788869371.212191:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788869371.212493:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324981376:12345-0@lo:41: Request processed in 351us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869371.212501:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869371.212618:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324981376:0@lo:41: 00010000:00010000:0.0:1788869372.104665:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869372.230846:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788869372.230858:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e283b46c800 from 39 10000000:01000000:2.0:1788869372.230864:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869372.230919:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.230933:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.230944:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869372.230970:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324981504:0@lo:101: 00000100:00100000:2.0:1788869372.231047:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.231094:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.231116:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324981504 00000100:00100000:2.0:1788869372.231132:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324981504 00000100:00100000:2.0:1788869372.231240:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788869372.231250:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765324981504:12345-0@lo:101: 00010000:00010000:2.0:1788869372.231264:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869372.231277:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce7a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.231304:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7a8 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.231315:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7a8 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.231325:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb800, rc 0) 00000100:00100000:2.0:1788869372.231365:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324981504:12345-0@lo:101: Request processed in 116us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.231373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788869372.231439:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324981504:0@lo:101: 00010000:00010000:2.0:1788869372.231455:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.231464:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869372.231523:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324981632:0@lo:501: 00000100:00100000:2.0:1788869372.231549:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.231578:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.232611:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324981632 00000100:00100000:1.0:1788869372.232621:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324981632 00000100:00100000:1.0:1788869372.232659:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788869372.232667:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324981632:12345-0@lo:501: 00000100:00100000:1.0:1788869372.232820:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324981632:12345-0@lo:501: Request processed in 154us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.232827:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788869372.232884:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324981632:0@lo:501: 00000100:00100000:1.0:1788869372.232921:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324981760:0@lo:503: 00000100:00100000:1.0:1788869372.232962:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.232988:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.233001:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324981760 00000100:00100000:1.0:1788869372.233005:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324981760 00000100:00100000:1.0:1788869372.233027:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788869372.233033:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324981760:12345-0@lo:503: 00000100:00100000:1.0:1788869372.233111:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324981760:12345-0@lo:503: Request processed in 77us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.233118:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788869372.233170:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324981760:0@lo:503: 00000100:00100000:1.0:1788869372.233366:0:9781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9781:1875765324981888:0@lo:502: 00000100:00100000:1.0:1788869372.233398:0:9781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.233418:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324981888 00000100:00100000:1.0:1788869372.233422:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324981888 00000100:00100000:1.0:1788869372.233446:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788869372.233452:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9781:x1875765324981888:12345-0@lo:502: 00000100:00100000:1.0:1788869372.233528:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9781:x1875765324981888:12345-0@lo:502: Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.233535:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788869372.233567:0:9781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.233578:0:9781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9781:1875765324981888:0@lo:502: 00000100:00100000:1.0:1788869372.233652:0:9781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9781:1875765324982016:0@lo:502: 00000100:00100000:1.0:1788869372.233684:0:9781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.233704:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324982016 00000100:00100000:1.0:1788869372.233708:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324982016 00000100:00100000:1.0:1788869372.233728:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788869372.233734:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9781:x1875765324982016:12345-0@lo:502: 00000100:00100000:1.0:1788869372.233791:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:9781:x1875765324982016:12345-0@lo:502: Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.233797:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788869372.233827:0:9781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.233838:0:9781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9781:1875765324982016:0@lo:502: 00000040:00080000:1.0:1788869372.233859:0:9781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788869372.233921:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788869372.233943:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869372.233954:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.233965:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869372.233974:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788869372.233985:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788869372.233988:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869372.234013:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.234021:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.234030:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869372.234042:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324982144:0@lo:101: 00000100:00100000:1.0:1788869372.234068:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.234082:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.234095:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324982144 00000100:00100000:1.0:1788869372.234098:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324982144 00000100:00100000:1.0:1788869372.234119:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788869372.234136:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765324982144:12345-0@lo:101: 00010000:00010000:1.0:1788869372.234145:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869372.234156:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce7b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.234180:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7b6 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.234191:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7b6 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.234202:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7fc00, rc 0) 00000100:00100000:1.0:1788869372.234231:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324982144:12345-0@lo:101: Request processed in 95us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.234244:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788869372.234280:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324982144:0@lo:101: 00010000:00010000:1.0:1788869372.234292:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.234302:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869372.234346:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324982272:0@lo:501: 00000100:00100000:1.0:1788869372.234371:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.234384:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.234396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324982272 00000100:00100000:1.0:1788869372.234399:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324982272 00000100:00100000:1.0:1788869372.234419:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788869372.234425:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324982272:12345-0@lo:501: 00000100:00100000:1.0:1788869372.234527:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324982272:12345-0@lo:501: Request processed in 101us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.234534:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788869372.234568:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324982272:0@lo:501: 00000100:00100000:1.0:1788869372.234619:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324982400:0@lo:503: 00000100:00100000:1.0:1788869372.234651:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.234666:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.234678:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324982400 00000100:00100000:1.0:1788869372.234681:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324982400 00000100:00100000:1.0:1788869372.234702:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788869372.234708:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324982400:12345-0@lo:503: 00000100:00100000:1.0:1788869372.234781:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324982400:12345-0@lo:503: Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.234787:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788869372.234825:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324982400:0@lo:503: 00000100:00100000:2.0:1788869372.235907:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324982912:0@lo:400: 00000100:00100000:2.0:1788869372.235958:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.235987:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324983424:0@lo:400: 00000100:00100000:2.0:1788869372.236012:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.236034:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788869372.236039:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765324982528:0@lo:400: 00000100:00100000:2.0:1788869372.236063:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.236080:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765324983040:0@lo:400: 00000100:00100000:2.0:1788869372.236101:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.236116:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765324983552:0@lo:400: 00000100:00100000:2.0:1788869372.236152:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.236176:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324982656:0@lo:400: 00000100:00100000:2.0:1788869372.236199:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.236215:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765324983168:0@lo:400: 00000100:00100000:2.0:1788869372.236235:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.236249:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765324983680:0@lo:400: 00000100:00100000:2.0:1788869372.236285:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.236299:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788869372.236417:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324982784:0@lo:400: 00000100:00100000:2.0:1788869372.236457:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.236474:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324983296:0@lo:400: 00000100:00100000:2.0:1788869372.236495:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.236528:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324982912 00000100:00100000:2.0:1788869372.236536:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324982912 00000100:00100000:2.0:1788869372.236572:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324982656 00000100:00100000:2.0:1788869372.236575:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324982656 00000100:00100000:2.0:1788869372.236616:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869372.236624:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324982912:12345-0@lo:400: 00000100:00100000:2.0:1788869372.236679:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324982912:12345-0@lo:400: Request processed in 55us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.236686:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869372.236701:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869372.236706:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324982656:12345-0@lo:400: 00000100:00100000:2.0:1788869372.236736:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324982656:12345-0@lo:400: Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.236741:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869372.236757:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324983424 00000100:00100000:2.0:1788869372.236760:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324983424 00000100:00100000:2.0:1788869372.236791:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324983296 00000100:00100000:2.0:1788869372.236795:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324983296 00000100:00100000:2.0:1788869372.236811:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869372.236817:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324983424:12345-0@lo:400: 00000100:00100000:2.0:1788869372.236848:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324983424:12345-0@lo:400: Request processed in 32us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.236861:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869372.236873:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869372.236879:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324983296:12345-0@lo:400: 00000100:00100000:2.0:1788869372.236908:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324983296:12345-0@lo:400: Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.236913:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788869372.236935:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869372.236965:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c5500 x1875765324983296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869372.236980:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324983296:0@lo:400: 00000100:00100000:2.0:1788869372.236991:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324982656:0@lo:400: 00000100:00100000:2.0:1788869372.237019:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324982912:0@lo:400: 00010000:00080000:2.0:1788869372.237029:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c7b80 x1875765324983424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869372.237037:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324983424:0@lo:400: 00000100:00100000:1.0:1788869372.239761:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324982528 00000100:00100000:1.0:1788869372.239780:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324982528 00000100:00100000:1.0:1788869372.239824:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324983040 00000100:00100000:1.0:1788869372.239827:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324983040 00000100:00100000:1.0:1788869372.239854:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324983552 00000100:00100000:1.0:1788869372.239857:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324983552 00000100:00100000:1.0:1788869372.239871:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324983168 00000100:00100000:1.0:1788869372.239874:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324983168 00000100:00100000:1.0:1788869372.239887:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324983680 00000100:00100000:1.0:1788869372.239890:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324983680 00000100:00100000:1.0:1788869372.239901:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324982784 00000100:00100000:1.0:1788869372.239903:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324982784 00000100:00100000:1.0:1788869372.239920:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869372.239929:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765324982528:12345-0@lo:400: 00000100:00100000:0.0:1788869372.240668:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869372.240688:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765324983040:12345-0@lo:400: 00000100:00100000:0.0:1788869372.240754:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765324983040:12345-0@lo:400: Request processed in 77us (4652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.240762:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869372.240796:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869372.240803:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765324983552:12345-0@lo:400: 00000100:00100000:0.0:1788869372.240837:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765324983552:12345-0@lo:400: Request processed in 35us (4684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.240843:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869372.240857:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869372.240863:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765324983168:12345-0@lo:400: 00000100:00100000:0.0:1788869372.240896:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765324983168:12345-0@lo:400: Request processed in 33us (4660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.240901:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788869372.240920:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869372.240923:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788869372.240926:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869372.240928:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765324983680:12345-0@lo:400: 00000100:00100000:0.0:1788869372.240958:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765324983680:12345-0@lo:400: Request processed in 30us (4672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.240968:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869372.240982:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869372.240988:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324982784:12345-0@lo:400: 00000100:00100000:1.0:1788869372.241003:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765324982528:12345-0@lo:400: Request processed in 1075us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.241010:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869372.241011:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324982784:12345-0@lo:400: Request processed in 24us (4555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.241016:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788869372.241058:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c6a00 x1875765324982784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869372.241074:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324982784:0@lo:400: 00010000:00080000:0.0:1788869372.241087:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c4700 x1875765324983168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869372.241095:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765324983168:0@lo:400: 00010000:00080000:0.0:1788869372.241105:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c7800 x1875765324983680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869372.241113:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765324983680:0@lo:400: 00010000:00080000:0.0:1788869372.241159:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c6d80 x1875765324982528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869372.241166:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765324982528:0@lo:400: 00000100:00100000:3.0:1788869372.241173:0:9782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9782:1875765324983808:0@lo:502: 00010000:00080000:0.0:1788869372.241176:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c5880 x1875765324983040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869372.241194:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765324983040:0@lo:400: 00010000:00080000:0.0:1788869372.241206:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c7100 x1875765324983552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869372.241214:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765324983552:0@lo:400: 00000100:00100000:3.0:1788869372.241510:0:9782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869372.241551:0:9782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.241614:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324983808 00000100:00100000:1.0:1788869372.241622:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324983808 00000100:00100000:1.0:1788869372.241662:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788869372.241668:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9782:x1875765324983808:12345-0@lo:502: 00000100:00100000:1.0:1788869372.241780:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9782:x1875765324983808:12345-0@lo:502: Request processed in 112us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.241786:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788869372.243690:0:9782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9782:1875765324983808:0@lo:502: 00000020:01000000:0.0:1788869372.243736:0:9782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869372.243748:0:9782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869372.243750:0:9782:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869372.243756:0:9782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869372.243758:0:9782:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788869372.243793:0:9782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9782:1875765324983936:0@lo:502: 00000100:00100000:0.0:1788869372.243857:0:9782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.243896:0:9782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869372.243952:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324983936 00000100:00100000:3.0:1788869372.243958:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324983936 00000100:00100000:3.0:1788869372.244011:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788869372.244020:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9782:x1875765324983936:12345-0@lo:502: 00000100:00100000:3.0:1788869372.244150:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:9782:x1875765324983936:12345-0@lo:502: Request processed in 131us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869372.244157:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788869372.244776:0:9782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9782:1875765324983936:0@lo:502: 00000020:01000000:0.0:1788869372.244797:0:9782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869372.244801:0:9782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869372.244803:0:9782:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788869372.244807:0:9782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788869372.245831:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788869372.245858:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788869372.245869:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.245883:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869372.245894:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788869372.245897:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e282daf5000 from 39 10000000:01000000:1.0:1788869372.245899:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869372.245935:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.245945:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.245956:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869372.245976:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984064:0@lo:101: 00000100:00100000:1.0:1788869372.246030:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.246072:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869372.246111:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324984064 00000100:00100000:0.0:1788869372.246118:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324984064 00000100:00100000:0.0:1788869372.246169:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788869372.246177:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765324984064:12345-0@lo:101: 00010000:00010000:0.0:1788869372.246189:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869372.246201:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce7c4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.246249:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7c4 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.246261:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7c4 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.246279:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030000, rc 0) 00000100:00100000:0.0:1788869372.246324:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324984064:12345-0@lo:101: Request processed in 147us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.246331:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788869372.246447:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984064:0@lo:101: 00010000:00010000:1.0:1788869372.246461:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.246470:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869372.246542:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984192:0@lo:501: 00000100:00100000:1.0:1788869372.246566:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.246610:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869372.247163:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324984192 00000100:00100000:0.0:1788869372.247169:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324984192 00000100:00100000:0.0:1788869372.247207:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788869372.247215:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324984192:12345-0@lo:501: 00000100:00100000:0.0:1788869372.247343:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324984192:12345-0@lo:501: Request processed in 128us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.247350:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869372.247420:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984192:0@lo:501: 00000100:00100000:3.0:1788869372.247454:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984320:0@lo:503: 00000100:00100000:3.0:1788869372.247496:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869372.247521:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.248258:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324984320 00000100:00100000:1.0:1788869372.248265:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324984320 00000100:00100000:1.0:1788869372.248305:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788869372.248312:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324984320:12345-0@lo:503: 00000100:00100000:1.0:1788869372.248407:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324984320:12345-0@lo:503: Request processed in 96us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.248414:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788869372.248513:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984320:0@lo:503: 00000100:00100000:0.0:1788869372.249029:0:9783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9783:1875765324984448:0@lo:502: 00000100:00100000:0.0:1788869372.249074:0:9783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.249108:0:9783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.249220:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324984448 00000100:00100000:1.0:1788869372.249225:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324984448 00000100:00100000:1.0:1788869372.249288:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788869372.249296:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:9783:x1875765324984448:12345-0@lo:502: 00000100:00100000:1.0:1788869372.249384:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:9783:x1875765324984448:12345-0@lo:502: Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.249391:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788869372.249556:0:9783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9783:1875765324984448:0@lo:502: 00000100:00100000:0.0:1788869372.249628:0:9783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9783:1875765324984576:0@lo:502: 00000100:00100000:0.0:1788869372.249661:0:9783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.254579:0:9783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869372.254749:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324984576 00000100:00100000:3.0:1788869372.254759:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324984576 00000100:00100000:3.0:1788869372.254823:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788869372.254833:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:9783:x1875765324984576:12345-0@lo:502: 00000100:00100000:3.0:1788869372.255011:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:9783:x1875765324984576:12345-0@lo:502: Request processed in 178us (5347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869372.255019:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788869372.255909:0:9783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9783:1875765324984576:0@lo:502: 00000040:00080000:0.0:1788869372.255956:0:9783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788869372.256119:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788869372.256153:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869372.256163:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.256175:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869372.256184:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788869372.256186:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e282daf5000 from 6 10000000:01000000:3.0:1788869372.256189:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869372.256222:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.256230:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.256240:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869372.256259:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984704:0@lo:101: 00000100:00100000:3.0:1788869372.256308:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869372.256426:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.258344:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324984704 00000100:00100000:1.0:1788869372.258360:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324984704 00000100:00100000:1.0:1788869372.258410:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788869372.258419:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765324984704:12345-0@lo:101: 00010000:00010000:1.0:1788869372.258435:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869372.258454:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce7d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce7d2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.258482:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7d2 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.258503:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7d2 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869372.258513:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f800, rc 0) 00000100:00100000:1.0:1788869372.258611:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765324984704:12345-0@lo:101: Request processed in 192us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.258617:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869372.258789:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984704:0@lo:101: 00010000:00010000:3.0:1788869372.258820:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.258841:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869372.258903:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984832:0@lo:256: 00000100:00100000:3.0:1788869372.258946:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869372.258978:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869372.258994:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324984832 00000100:00100000:3.0:1788869372.258998:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324984832 00000100:00100000:3.0:1788869372.259020:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869372.259026:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765324984832:12345-0@lo:256: 20000000:01000000:3.0:1788869372.259039:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869372.259056:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869372.259058:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788869372.259159:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765324984832:12345-0@lo:256: Request processed in 133us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869372.259166:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869372.259197:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984832:0@lo:256: 10000000:01000000:3.0:1788869372.259237:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788869372.259245:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.259253:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869372.259261:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788869372.259263:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788869372.259266:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788869372.259290:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.259298:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.259306:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869372.259318:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984960:0@lo:101: 00000100:00100000:3.0:1788869372.259345:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869372.259359:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869372.259370:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324984960 00000100:00100000:3.0:1788869372.259373:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324984960 00000100:00100000:3.0:1788869372.259390:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869372.259396:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765324984960:12345-0@lo:101: 00010000:00010000:3.0:1788869372.259404:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869372.259413:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce7e0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.259429:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7e0 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.259438:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7e0 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.259444:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8600, rc 0) 00000100:00100000:3.0:1788869372.259470:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324984960:12345-0@lo:101: Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869372.259476:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869372.259513:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324984960:0@lo:101: 00010000:00010000:3.0:1788869372.259523:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869372.259531:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869372.259580:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324985088:0@lo:501: 00000100:00100000:3.0:1788869372.259626:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869372.259640:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869372.259651:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324985088 00000100:00100000:3.0:1788869372.259654:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324985088 00000100:00100000:3.0:1788869372.259671:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788869372.259677:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324985088:12345-0@lo:501: 00000100:00100000:3.0:1788869372.259797:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324985088:12345-0@lo:501: Request processed in 119us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869372.259803:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788869372.259828:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324985088:0@lo:501: 00000100:00100000:3.0:1788869372.259855:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324985216:0@lo:503: 00000100:00100000:3.0:1788869372.259890:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869372.259902:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869372.259912:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324985216 00000100:00100000:3.0:1788869372.259915:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324985216 00000100:00100000:3.0:1788869372.259929:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788869372.259934:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324985216:12345-0@lo:503: 00000100:00100000:3.0:1788869372.260008:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324985216:12345-0@lo:503: Request processed in 73us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869372.260022:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788869372.260059:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324985216:0@lo:503: 00000100:00100000:1.0:1788869372.276316:0:9787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9787:1875765324985344:0@lo:502: 00000100:00100000:1.0:1788869372.276405:0:9787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.276461:0:9787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d7e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.277410:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324985344 00000100:00100000:2.0:1788869372.277423:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324985344 00000100:00100000:2.0:1788869372.277483:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788869372.277495:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:9787:x1875765324985344:12345-0@lo:502: 00000100:00100000:2.0:1788869372.277667:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:9787:x1875765324985344:12345-0@lo:502: Request processed in 174us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.277686:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788869372.277990:0:9787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9787:1875765324985344:0@lo:502: 00000020:01000000:1.0:1788869372.278046:0:9787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788869372.278054:0:9787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788869372.278061:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869372.278064:0:9787:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788869372.278069:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788869372.278073:0:9787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:1.0:1788869372.278101:0:9787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788869372.278104:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869372.278131:0:9787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8e28411e4d40) 00000020:00000080:1.0:1788869372.278158:0:9787:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788869372.278179:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788869372.278279:0:9787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788869372.278286:0:9787:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788869372.278294:0:9787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6ce7f5 00010000:00080000:1.0:1788869372.278325:0:9787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e283b46d000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788869372.279286:0:9787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788869372.279429:0:9787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788869372.279442:0:9787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788869372.279659:0:9787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869372.279774:0:9787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869372.279919:0:9787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788869372.280024:0:9787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788869372.284054:0:9788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869372.284063:0:9788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788869372.288669:0:9787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869372.288759:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869372.288890:0:9787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788869372.288918:0:9787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6ce7fc 00000100:00080000:2.0:1788869372.288931:0:9787:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869372.288945:0:9787:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e283b46d000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869372.288985:0:9787:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27039f1c00 x1875765324985472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869372.289009:0:9787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788869372.289068:0:9787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869372.289074:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869372.289076:0:9787:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788869372.289080:0:9787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869372.289083:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869372.289085:0:9787:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869372.289088:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869372.289090:0:9787:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788869372.289117:0:9787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9787:1875765324985600:0@lo:502: 00000100:00100000:2.0:1788869372.289207:0:9787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.289242:0:9787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869372.289327:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765324985472:0@lo:8: 00000100:00100000:0.0:1788869372.289365:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.289404:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324985600 00000100:00100000:0.0:1788869372.289411:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324985600 00000100:00100000:0.0:1788869372.289456:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788869372.289465:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:9787:x1875765324985600:12345-0@lo:502: 00000100:00100000:0.0:1788869372.289606:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:9787:x1875765324985600:12345-0@lo:502: Request processed in 141us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.289614:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788869372.290353:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324985472 00000100:00100000:2.0:1788869372.290361:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324985472 00000100:00100000:2.0:1788869372.290907:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869372.290915:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765324985472:12345-0@lo:8: 00010000:00080000:2.0:1788869372.290946:0:8743:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:2.0:1788869372.290977:0:8743:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6ce803 00002000:00100000:2.0:1788869372.290992:0:8743:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8e282dbad800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788869372.290997:0:8743:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788869372.291000:0:8743:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788869372.291058:0:8743:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788869372.291328:0:8743:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788869372.291354:0:8743:0:(import.c:65:import_set_state_nolock()) ffff8e282dba8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869372.291421:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765324985472:12345-0@lo:8: Request processed in 505us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.291428:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788869372.294071:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f1c00 x1875765324985472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869372.294087:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869372.294097:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788869372.294108:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788869372.294115:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788869372.294131:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e283b46d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788869372.294151:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788869372.294158:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765324985472:0@lo:8: 00000004:00080000:1.0:1788869372.294195:0:9788:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788869372.294288:0:9788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 306207700674ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788869372.294296:0:9788:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788869372.294820:0:9787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9787:1875765324985600:0@lo:502: 00000020:01000000:1.0:1788869372.294875:0:9787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869372.294883:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869372.294886:0:9787:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788869372.294892:0:9787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1788869372.295047:0:9789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9789:1875765324985728:0@lo:700: 00000100:00100000:1.0:1788869372.295107:0:9789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.295149:0:9789:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d7e480 going to sleep for 11 seconds 00000004:00080000:3.0:1788869372.296627:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788869372.299296:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324985728 00000100:00100000:0.0:1788869372.299312:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324985728 00000100:00100000:0.0:1788869372.299380:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869372.299392:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9789:x1875765324985728:12345-0@lo:700: 00000100:00100000:0.0:1788869372.299458:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8450:1875765324985856:0@lo:700: 00000100:00100000:0.0:1788869372.299538:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.299571:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927240 going to sleep for 11 seconds 00000020:01000000:0.0:1788869372.302894:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788869372.302936:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788869372.302949:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.302962:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869372.302975:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788869372.302977:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e281757b800 from 39 10000000:01000000:0.0:1788869372.302997:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869372.303041:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.303049:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.303060:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869372.303085:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324985984:0@lo:101: 00000100:00100000:0.0:1788869372.303161:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.303211:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927a80 going to sleep for 11 seconds 00000100:00080000:0.0:1788869372.303238:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869372.303262:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324985856 00000100:00100000:0.0:1788869372.303270:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324985856 00000100:00100000:0.0:1788869372.303318:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869372.303327:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8450:x1875765324985856:12345-0@lo:700: 00000100:00100000:0.0:1788869372.303703:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324985984 00000100:00100000:0.0:1788869372.303709:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324985984 00000100:00100000:0.0:1788869372.303780:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788869372.303788:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765324985984:12345-0@lo:101: 00010000:00010000:0.0:1788869372.303798:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869372.303886:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce80a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.303910:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce80a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.303922:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce80a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.303941:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030c00, rc 0) 00000100:00100000:0.0:1788869372.303991:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765324985984:12345-0@lo:101: Request processed in 204us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.303998:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788869372.304040:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324985984:0@lo:101: 00010000:00010000:0.0:1788869372.304054:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.304063:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869372.304147:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986112:0@lo:501: 00000100:00100000:0.0:1788869372.304178:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.309526:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.312860:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324986112 00000100:00100000:1.0:1788869372.312889:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324986112 00000100:00100000:1.0:1788869372.312954:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788869372.312964:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765324986112:12345-0@lo:501: 00000100:00100000:1.0:1788869372.313167:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765324986112:12345-0@lo:501: Request processed in 204us (8987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.313176:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788869372.313641:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986112:0@lo:501: 00000100:00100000:0.0:1788869372.313707:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986240:0@lo:503: 00000100:00100000:0.0:1788869372.313761:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.313794:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869372.313820:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324986240 00000100:00100000:0.0:1788869372.313825:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324986240 00000100:00100000:0.0:1788869372.313848:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788869372.313855:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765324986240:12345-0@lo:503: 00000100:00100000:0.0:1788869372.313936:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765324986240:12345-0@lo:503: Request processed in 81us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.313943:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788869372.313986:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986240:0@lo:503: 00000100:00100000:1.0:1788869372.317746:0:9790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9790:1875765324986368:0@lo:502: 00000100:00100000:1.0:1788869372.317830:0:9790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.317869:0:9790:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28200b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.317939:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324986368 00000100:00100000:2.0:1788869372.317946:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324986368 00000100:00100000:2.0:1788869372.317991:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788869372.318001:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:9790:x1875765324986368:12345-0@lo:502: 00000100:00100000:2.0:1788869372.318238:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:9790:x1875765324986368:12345-0@lo:502: Request processed in 238us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.318247:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788869372.318464:0:9790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9790:1875765324986368:0@lo:502: 00000100:00100000:1.0:1788869372.318565:0:9790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9790:1875765324986496:0@lo:502: 00000100:00100000:1.0:1788869372.318627:0:9790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.318648:0:9790:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28200b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.318749:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324986496 00000100:00100000:2.0:1788869372.318755:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324986496 00000100:00100000:2.0:1788869372.318782:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788869372.318789:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:9790:x1875765324986496:12345-0@lo:502: 00000100:00100000:2.0:1788869372.318855:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:9790:x1875765324986496:12345-0@lo:502: Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.318862:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 40000000:02000000:1.0:1788869372.318980:0:6531:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788869372.319676:0:9790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9790:1875765324986496:0@lo:502: 00000040:00080000:0.0:1788869372.319713:0:9790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788869372.319902:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788869372.319926:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869372.319935:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.319947:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869372.319957:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869372.319971:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e281757b800 from 6 10000000:01000000:2.0:1788869372.319974:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869372.320001:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.320009:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.320018:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869372.320032:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986624:0@lo:101: 00000100:00100000:2.0:1788869372.320073:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.320106:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869372.320164:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324986624 00000100:00100000:0.0:1788869372.320169:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324986624 00000100:00100000:0.0:1788869372.320208:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788869372.320216:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765324986624:12345-0@lo:101: 00010000:00010000:0.0:1788869372.320227:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869372.320240:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce81f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce818 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.320265:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce818 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.320276:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce818 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869372.320285:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800031800, rc 0) 00000100:00100000:0.0:1788869372.320319:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765324986624:12345-0@lo:101: Request processed in 103us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.320325:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788869372.320393:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986624:0@lo:101: 00010000:00010000:2.0:1788869372.320406:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.320414:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869372.320461:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986752:0@lo:256: 00000100:00100000:2.0:1788869372.320489:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.320509:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.320522:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324986752 00000100:00100000:2.0:1788869372.320525:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324986752 00000100:00100000:2.0:1788869372.320548:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788869372.320555:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765324986752:12345-0@lo:256: 20000000:01000000:2.0:1788869372.320568:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869372.320616:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869372.320619:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788869372.320701:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765324986752:12345-0@lo:256: Request processed in 146us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.320708:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788869372.320735:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986752:0@lo:256: 10000000:01000000:2.0:1788869372.320776:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869372.320781:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.320789:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869372.320796:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788869372.320798:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788869372.320800:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788869372.320815:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.320821:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.320828:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869372.320839:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986880:0@lo:101: 00000100:00100000:2.0:1788869372.320862:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.320877:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.320887:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324986880 00000100:00100000:2.0:1788869372.320891:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324986880 00000100:00100000:2.0:1788869372.320914:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869372.320919:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765324986880:12345-0@lo:101: 00010000:00010000:2.0:1788869372.320926:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869372.320934:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce826 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.320948:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce826 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.320956:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce826 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.320962:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edbe00, rc 0) 00000100:00100000:2.0:1788869372.320989:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765324986880:12345-0@lo:101: Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.320995:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869372.321022:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324986880:0@lo:101: 00010000:00010000:2.0:1788869372.321033:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.321041:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869372.321088:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324987008:0@lo:501: 00000100:00100000:2.0:1788869372.321111:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.321135:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280b02fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.321147:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324987008 00000100:00100000:2.0:1788869372.321150:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324987008 00000100:00100000:2.0:1788869372.321165:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788869372.321176:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765324987008:12345-0@lo:501: 00000100:00100000:2.0:1788869372.321289:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765324987008:12345-0@lo:501: Request processed in 112us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.321296:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788869372.321324:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324987008:0@lo:501: 00000100:00100000:2.0:1788869372.321349:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324987136:0@lo:503: 00000100:00100000:2.0:1788869372.321385:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.321399:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280b02fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.321410:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324987136 00000100:00100000:2.0:1788869372.321413:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324987136 00000100:00100000:2.0:1788869372.321429:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788869372.321435:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765324987136:12345-0@lo:503: 00000100:00100000:2.0:1788869372.321503:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765324987136:12345-0@lo:503: Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.321510:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788869372.321545:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324987136:0@lo:503: 00000100:00100000:0.0:1788869372.327942:0:9791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9791:1875765324987264:0@lo:502: 00000100:00100000:0.0:1788869372.328040:0:9791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.328090:0:9791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.328167:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324987264 00000100:00100000:2.0:1788869372.328175:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324987264 00000100:00100000:2.0:1788869372.328264:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788869372.328274:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:9791:x1875765324987264:12345-0@lo:502: 00000100:00100000:2.0:1788869372.328404:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:9791:x1875765324987264:12345-0@lo:502: Request processed in 131us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.328412:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788869372.333959:0:9791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9791:1875765324987264:0@lo:502: 00000020:01000000:0.0:1788869372.334009:0:9791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869372.334018:0:9791:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788869372.334032:0:9791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869372.334034:0:9791:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788869372.334039:0:9791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788869372.334043:0:9791:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:0.0:1788869372.334068:0:9791:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788869372.334071:0:9791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869372.334086:0:9791:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e2840a399c0) 00000020:00000080:0.0:1788869372.334109:0:9791:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788869372.334114:0:9791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788869372.334211:0:9791:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788869372.334218:0:9791:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788869372.334224:0:9791:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6ce83b 00010000:00080000:0.0:1788869372.334254:0:9791:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2702582000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1788869372.334476:0:9791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788869372.334634:0:9791:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788869372.334647:0:9791:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788869372.334821:0:9791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869372.334929:0:9791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869372.335049:0:9791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788869372.335165:0:9791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:1.0:1788869372.335682:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8450:x1875765324985856:12345-0@lo:700: Request processed in 32353us (36140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.335694:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788869372.335738:0:8450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282da8ad80 x1875765324985856/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869372.335751:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8450:1875765324985856:0@lo:700: 40000000:02000000:1.0:1788869372.335760:0:8450:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:0.0:1788869372.338869:0:9792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869372.338877:0:9792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788869372.346007:0:9791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788869372.346024:0:9791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788869372.346065:0:9791:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788869372.346091:0:9791:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6ce842 00000100:00080000:3.0:1788869372.346102:0:9791:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869372.346114:0:9791:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2702582000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869372.346162:0:9791:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a3800 x1875765324987392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869372.346186:0:9791:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788869372.346238:0:9791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869372.346242:0:9791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869372.346244:0:9791:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788869372.346247:0:9791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869372.346250:0:9791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869372.346251:0:9791:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869372.346254:0:9791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869372.346256:0:9791:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788869372.346282:0:9791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9791:1875765324987520:0@lo:502: 00000100:00100000:3.0:1788869372.346364:0:9791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869372.346403:0:9791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869372.346440:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324987520 00000100:00100000:3.0:1788869372.346446:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324987520 00000100:00100000:3.0:1788869372.346487:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788869372.346496:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:9791:x1875765324987520:12345-0@lo:502: 00000100:00100000:3.0:1788869372.346632:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:9791:x1875765324987520:12345-0@lo:502: Request processed in 136us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869372.346656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788869372.346708:0:9791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:9791:1875765324987520:0@lo:502: 00000020:01000000:3.0:1788869372.346731:0:9791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869372.346735:0:9791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869372.346736:0:9791:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788869372.346740:0:9791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:0.0:1788869372.346899:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765324987392:0@lo:8: 00000100:00100000:0.0:1788869372.346936:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.346971:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324987392 00000100:00100000:0.0:1788869372.346975:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324987392 00000100:00100000:0.0:1788869372.347001:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869372.347006:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765324987392:12345-0@lo:8: 00010000:00080000:0.0:1788869372.347029:0:8443:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:0.0:1788869372.347055:0:8443:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6ce849 00002000:00100000:0.0:1788869372.347075:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e2702581800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788869372.347079:0:8443:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788869372.347082:0:8443:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:2.0:1788869372.347279:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788869372.347304:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788869372.347315:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.347332:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869372.347343:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788869372.347345:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e282a933380 from 1 10000000:01000000:2.0:1788869372.347348:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788869372.347373:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.347381:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.347388:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869372.347409:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324987648:0@lo:101: 00000100:00100000:2.0:1788869372.347438:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.347453:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.347469:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324987648 00000100:00100000:2.0:1788869372.347472:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324987648 00000100:00100000:2.0:1788869372.347494:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788869372.347500:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765324987648:12345-0@lo:101: 00010000:00010000:2.0:1788869372.347509:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869372.347521:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce850 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.347540:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce850 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.347562:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce850 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.347571:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edaa00, rc 0) 00000100:00100000:2.0:1788869372.347619:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765324987648:12345-0@lo:101: Request processed in 118us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.347625:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788869372.347653:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324987648:0@lo:101: 00010000:00010000:2.0:1788869372.347663:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.347672:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869372.347717:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324987776:0@lo:501: 00000100:00100000:2.0:1788869372.347738:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.347749:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0a900 going to sleep for 11 seconds 00002000:00080000:0.0:1788869372.347840:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788869372.347864:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8e2702584800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869372.347912:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765324987392:12345-0@lo:8: Request processed in 904us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.347920:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788869372.347981:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a3800 x1875765324987392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869372.347992:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869372.347998:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788869372.348004:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788869372.348009:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788869372.348011:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2702582000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869372.349151:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324987776 00000100:00100000:3.0:1788869372.349160:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324987776 00000100:00100000:3.0:1788869372.349193:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788869372.349201:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765324987776:12345-0@lo:501: 00000100:00100000:3.0:1788869372.349289:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765324987776:12345-0@lo:501: Request processed in 89us (1549us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869372.349297:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000004:00080000:2.0:1788869372.350717:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788869372.350730:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765324987392:0@lo:8: 00000100:00100000:2.0:1788869372.350789:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765324987776:0@lo:501: 10000000:01000000:2.0:1788869372.350823:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788869372.350832:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869372.350844:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869372.350866:0:9792:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788869372.350936:0:9792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306264348047ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788869372.350942:0:9792:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:1.0:1788869372.351269:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788869372.353349:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9789:x1875765324985728:12345-0@lo:700: Request processed in 53952us (58235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.353363:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788869372.355538:0:9789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db34e00 x1875765324985728/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869372.355554:0:9789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9789:1875765324985728:0@lo:700: 00000004:00080000:2.0:1788869372.355960:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788869372.363134:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869372.363157:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324987904:0@lo:13: 00000100:00100000:0.0:1788869372.363227:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788869372.363270:0:9793:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788869372.363291:0:9793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9793:1875765324988032:0@lo:7: 00000100:00100000:0.0:1788869372.363316:0:9793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.363341:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324988032 00000100:00100000:3.0:1788869372.363345:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324987904 00000100:00100000:0.0:1788869372.363348:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324988032 00000100:00100000:3.0:1788869372.363349:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324987904 00000100:00100000:3.0:1788869372.363397:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869372.363397:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869372.363406:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875765324987904:12345-0@lo:13: 00000100:00100000:0.0:1788869372.363406:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:9793:x1875765324988032:12345-0@lo:7: 00002000:00000024:3.0:1788869372.363431:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788869372.363478:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875765324987904:12345-0@lo:13: Request processed in 73us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869372.363485:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788869372.363532:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a33b80 x1875765324987904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869372.363551:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324987904:0@lo:13: 00002000:00080000:0.0:1788869372.367440:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788869372.367448:0:8442:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788869372.367532:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9793:x1875765324988032:12345-0@lo:7: Request processed in 4122us (4209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869372.367544:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788869372.367580:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869372.367614:0:9793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927840 going to sleep for 11 seconds 00010000:00080000:0.0:1788869372.367644:0:9793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31c00 x1875765324988032/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869372.367660:0:9793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9793:1875765324988032:0@lo:7: 00000004:00080000:0.0:1788869372.367682:0:9793:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788869372.367958:0:9793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9793:1875765324988160:0@lo:5: 00000100:00100000:0.0:1788869372.367994:0:9793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.368026:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324988160 00000100:00100000:0.0:1788869372.368033:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324988160 00000100:00100000:0.0:1788869372.368096:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869372.368104:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9793:x1875765324988160:12345-0@lo:5: 00002000:00080000:0.0:1788869372.368139:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788869372.368142:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788869372.368520:0:9793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927840 going to sleep for 11 seconds 00000001:00080000:1.0:1788869372.370537:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788869372.370553:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788869372.370673:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9793:x1875765324988160:12345-0@lo:5: Request processed in 2565us (2674us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788869372.370683:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869372.370825:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324988288:0@lo:13: 00000100:00100000:1.0:1788869372.370867:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788869372.370879:0:9789:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788869372.370901:0:9789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9789:1875765324988416:0@lo:7: 00000100:00100000:1.0:1788869372.370918:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324988288 00000100:00100000:1.0:1788869372.370925:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324988288 00000100:00100000:2.0:1788869372.370933:0:9789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869372.370948:0:9789:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.370961:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869372.370965:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324988416 00000100:00100000:2.0:1788869372.370968:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324988416 00000100:00100000:1.0:1788869372.370970:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324988288:12345-0@lo:13: 00002000:00000024:1.0:1788869372.370988:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788869372.370990:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869372.370995:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9789:x1875765324988416:12345-0@lo:7: 00000100:00100000:1.0:1788869372.371020:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875765324988288:12345-0@lo:13: Request processed in 51us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.371025:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788869372.371072:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f0a80 x1875765324988288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869372.371089:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324988288:0@lo:13: 00010000:00080000:0.0:1788869372.371327:0:9793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31c00 x1875765324988160/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869372.371338:0:9793:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788869372.371343:0:9793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9793:1875765324988160:0@lo:5: 00000004:00080000:0.0:1788869372.371354:0:9793:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788869372.371386:0:9793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9793:1875765324988544:0@lo:700: 00000100:00100000:0.0:1788869372.371413:0:9793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869372.371438:0:9793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.371573:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324988544 00000100:00100000:1.0:1788869372.371578:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324988544 00000100:00100000:1.0:1788869372.371622:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869372.371629:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9793:x1875765324988544:12345-0@lo:700: 00002000:00080000:2.0:1788869372.379692:0:8743:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788869372.379711:0:8743:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788869372.379812:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9789:x1875765324988416:12345-0@lo:7: Request processed in 8811us (8873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.379823:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788869372.379984:0:9789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f3480 x1875765324988416/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869372.380002:0:9789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9789:1875765324988416:0@lo:7: 00000004:00080000:1.0:1788869372.380042:0:9789:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788869372.380092:0:9789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9789:1875765324988672:0@lo:5: 00000100:00100000:1.0:1788869372.380138:0:9789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.380165:0:9789:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28200b6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.380182:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324988672 00000100:00100000:1.0:1788869372.380188:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324988672 00000100:00100000:1.0:1788869372.380229:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869372.380239:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9789:x1875765324988672:12345-0@lo:5: 00002000:00080000:1.0:1788869372.380263:0:8443:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788869372.380293:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9789:x1875765324988672:12345-0@lo:5: Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.380299:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788869372.380342:0:9789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db37100 x1875765324988672/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869372.380351:0:9789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9789:1875765324988672:0@lo:5: 00000004:00080000:1.0:1788869372.380358:0:9789:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788869372.380389:0:9789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9789:1875765324988800:0@lo:5: 00000100:00100000:1.0:1788869372.380408:0:9789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.380424:0:9789:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28200b6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869372.380435:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324988800 00000100:00100000:1.0:1788869372.380439:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324988800 00000100:00100000:1.0:1788869372.380459:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869372.380465:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9789:x1875765324988800:12345-0@lo:5: 00002000:00080000:1.0:1788869372.380491:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1788869372.382085:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9789:x1875765324988800:12345-0@lo:5: Request processed in 1615us (1670us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788869372.382095:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788869372.382168:0:9789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db37100 x1875765324988800/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869372.382182:0:9789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9789:1875765324988800:0@lo:5: 00000004:00080000:1.0:1788869372.382193:0:9789:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788869372.382227:0:9789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9789:1875765324988928:0@lo:900: 00000100:00100000:1.0:1788869372.382258:0:9789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.382287:0:9789:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28200b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.382676:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324988928 00000100:00100000:2.0:1788869372.382684:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324988928 00000100:00100000:2.0:1788869372.382732:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869372.382742:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9789:x1875765324988928:12345-0@lo:900: 00000100:00100000:2.0:1788869372.382794:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9789:x1875765324988928:12345-0@lo:900: Request processed in 55us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869372.382801:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788869372.382827:0:9789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db35500 x1875765324988928/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869372.382837:0:9789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9789:1875765324988928:0@lo:900: 00000100:00100000:1.0:1788869372.383084:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9793:x1875765324988544:12345-0@lo:700: Request processed in 11454us (11668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869372.383092:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788869372.387200:0:9793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31c00 x1875765324988544/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869372.387221:0:9793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9793:1875765324988544:0@lo:700: 00000004:02000040:1.0:1788869372.392975:0:9793:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1788869372.399911:0:9793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db37800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9793:1875765324989056:0@lo:5: 00000100:00100000:1.0:1788869372.399993:0:9793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869372.400038:0:9793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28200b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869372.400152:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324989056 00000100:00100000:2.0:1788869372.400162:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324989056 00000100:00100000:2.0:1788869372.400227:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869372.400237:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9793:x1875765324989056:12345-0@lo:5: 00002000:00080000:2.0:1788869372.408018:0:8443:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788869372.408038:0:8443:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788869372.409558:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9793:x1875765324989056:12345-0@lo:5: Request processed in 9315us (9558us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788869372.409570:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788869372.409950:0:9793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db37800 x1875765324989056/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869372.409968:0:9793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db37800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9793:1875765324989056:0@lo:5: 00000004:00080000:1.0:1788869372.409983:0:9793:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1788869373.140910:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869374.154405:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869374.194209:0:9890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788869374.280614:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324989184:0@lo:41: 00000100:00100000:1.0:1788869374.280712:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869374.280838:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324989184 00000100:00100000:2.0:1788869374.280850:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324989184 00000100:00100000:2.0:1788869374.280917:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788869374.280928:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324989184:12345-0@lo:41: 00000004:00000024:2.0:1788869374.280973:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788869374.281027:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324989184:12345-0@lo:41: Request processed in 101us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869374.281050:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788869374.281105:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324989184:0@lo:41: 00000020:00000004:1.0:1788869375.050049:0:9942:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869375.050329:0:9942:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869375.176784:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869375.301842:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788869375.301874:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324989440:0@lo:13: 00000100:00100000:0.0:1788869375.301951:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869375.302022:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324989312:0@lo:13: 00000100:00100000:3.0:1788869375.302047:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324989440 00000100:00100000:0.0:1788869375.302061:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869375.302071:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324989440 00000100:00100000:3.0:1788869375.302118:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324989312 00000100:00100000:3.0:1788869375.302121:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324989312 00000100:00100000:1.0:1788869375.302147:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869375.302161:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324989440:12345-0@lo:13: 00002000:00000024:1.0:1788869375.302191:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869375.302258:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324989440:12345-0@lo:13: Request processed in 100us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869375.302265:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869375.302274:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869375.302285:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324989312:12345-0@lo:13: 00002000:00000024:3.0:1788869375.302297:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869375.302329:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324989312:12345-0@lo:13: Request processed in 48us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869375.302336:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788869375.302351:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31c00 x1875765324989440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869375.302356:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869375.302375:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324989440:0@lo:13: 00010000:00080000:0.0:1788869375.302387:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a1180 x1875765324989312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869375.302398:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324989312:0@lo:13: 00000001:00080000:2.0:1788869375.975949:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1788869375.975972:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788869376.198455:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869376.326978:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869376.327012:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324989568:0@lo:41: 00000100:00100000:1.0:1788869376.327352:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869376.327576:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324989568 00000100:00100000:0.0:1788869376.327603:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324989568 00000100:00100000:0.0:1788869376.327672:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788869376.327681:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324989568:12345-0@lo:41: 00000004:00000024:0.0:1788869376.327940:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869376.328004:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324989568:12345-0@lo:41: Request processed in 324us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869376.328012:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869376.328238:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324989568:0@lo:41: 00010000:00010000:1.0:1788869377.232252:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869377.354165:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324989952:0@lo:400: 00000100:00100000:1.0:1788869377.354239:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869377.354297:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765324990464:0@lo:400: 00000100:00100000:1.0:1788869377.354324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869377.354343:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765324990976:0@lo:400: 00000100:00100000:1.0:1788869377.354366:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869377.354410:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869377.354416:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324990080:0@lo:400: 00000100:00100000:1.0:1788869377.354440:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869377.354458:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324990592:0@lo:400: 00000100:00100000:1.0:1788869377.354481:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869377.354502:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324991104:0@lo:400: 00000100:00100000:1.0:1788869377.354522:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869377.354566:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324989952 00000100:00100000:1.0:1788869377.354575:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324989952 00000100:00100000:1.0:1788869377.354648:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869377.354659:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324989952:12345-0@lo:400: 00000100:00100000:1.0:1788869377.354718:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324989952:12345-0@lo:400: Request processed in 60us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869377.354734:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869377.354776:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324990464 00000100:00100000:1.0:1788869377.354780:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324990464 00000100:00100000:1.0:1788869377.354818:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324990976 00000100:00100000:1.0:1788869377.354821:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324990976 00000100:00100000:1.0:1788869377.354834:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324990080 00000100:00100000:1.0:1788869377.354837:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324990080 00000100:00100000:1.0:1788869377.354849:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869377.354855:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765324990464:12345-0@lo:400: 00000100:00100000:1.0:1788869377.354890:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765324990464:12345-0@lo:400: Request processed in 35us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869377.354896:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869377.354909:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788869377.354915:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765324990976:12345-0@lo:400: 00000100:00100000:1.0:1788869377.354957:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765324990976:12345-0@lo:400: Request processed in 41us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869377.354962:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788869377.354976:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869377.354981:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324990080:12345-0@lo:400: 00000100:00100000:1.0:1788869377.355017:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324990080:12345-0@lo:400: Request processed in 22us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869377.355022:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869377.355047:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324990592 00000100:00100000:1.0:1788869377.355051:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324990592 00000100:00100000:1.0:1788869377.355071:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324991104 00000100:00100000:1.0:1788869377.355074:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324991104 00000100:00100000:1.0:1788869377.355089:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869377.355095:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324990592:12345-0@lo:400: 00000100:00100000:1.0:1788869377.355128:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324990592:12345-0@lo:400: Request processed in 35us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869377.355134:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869377.355149:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869377.355155:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324991104:12345-0@lo:400: 00000100:00100000:1.0:1788869377.355181:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324991104:12345-0@lo:400: Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869377.355187:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788869377.355207:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869377.355212:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869377.355215:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788869377.355252:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5c700 x1875765324990080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869377.355268:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324990080:0@lo:400: 00010000:00080000:1.0:1788869377.355279:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8ea00 x1875765324990592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869377.355287:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324990592:0@lo:400: 00010000:00080000:1.0:1788869377.355297:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283b470a80 x1875765324991104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869377.355305:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788869377.355326:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324991104:0@lo:400: 00000100:00100000:1.0:1788869377.355336:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324989952:0@lo:400: 00010000:00080000:1.0:1788869377.355346:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8ed80 x1875765324990464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869377.355367:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765324990464:0@lo:400: 00010000:00080000:1.0:1788869377.355379:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283b470000 x1875765324990976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869377.355386:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765324990976:0@lo:400: 00000100:00100000:2.0:1788869377.355646:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324989696:0@lo:400: 00000100:00100000:2.0:1788869377.355688:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869377.355714:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324990208:0@lo:400: 00000100:00100000:2.0:1788869377.355736:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869377.355756:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324990720:0@lo:400: 00000100:00100000:2.0:1788869377.355774:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869377.355789:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324991232:0@lo:400: 00000100:00100000:2.0:1788869377.355806:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869377.355821:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788869377.355826:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765324989824:0@lo:400: 00000100:00100000:2.0:1788869377.355845:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869377.355859:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765324990336:0@lo:400: 00000100:00100000:2.0:1788869377.355876:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869377.355890:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765324990848:0@lo:400: 00000100:00100000:2.0:1788869377.355907:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869377.355932:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324990720 00000100:00100000:2.0:1788869377.355937:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324990720 00000100:00100000:2.0:1788869377.355962:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324991232 00000100:00100000:2.0:1788869377.355965:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324991232 00000100:00100000:2.0:1788869377.355979:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869377.355985:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324990720:12345-0@lo:400: 00000100:00100000:2.0:1788869377.356045:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324990720:12345-0@lo:400: Request processed in 59us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869377.356051:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869377.356064:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869377.356069:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324991232:12345-0@lo:400: 00000100:00100000:2.0:1788869377.356090:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324991232:12345-0@lo:400: Request processed in 22us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869377.356096:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869377.356114:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324990208 00000100:00100000:2.0:1788869377.356117:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324990208 00000100:00100000:2.0:1788869377.356138:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788869377.356144:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324990208:12345-0@lo:400: 00000100:00100000:2.0:1788869377.356169:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324990208:12345-0@lo:400: Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869377.356173:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788869377.356186:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324989824 00000100:00100000:2.0:1788869377.356189:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324989824 00000100:00100000:2.0:1788869377.356205:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324990336 00000100:00100000:2.0:1788869377.356207:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324990336 00000100:00100000:2.0:1788869377.356216:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324990848 00000100:00100000:2.0:1788869377.356219:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324990848 00000100:00100000:2.0:1788869377.356228:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869377.356232:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765324989824:12345-0@lo:400: 00000100:00100000:2.0:1788869377.356257:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765324989824:12345-0@lo:400: Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869377.356262:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869377.356270:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869377.356275:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765324990336:12345-0@lo:400: 00000100:00100000:2.0:1788869377.356307:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765324990336:12345-0@lo:400: Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869377.356313:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869377.356323:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869377.356329:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765324990848:12345-0@lo:400: 00000100:00100000:2.0:1788869377.356352:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765324990848:12345-0@lo:400: Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869377.356357:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788869377.356379:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869377.356400:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869377.356402:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869377.356433:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282da8ad80 x1875765324989824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869377.356444:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765324989824:0@lo:400: 00010000:00080000:2.0:1788869377.356453:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8e680 x1875765324990336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869377.356460:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765324990336:0@lo:400: 00010000:00080000:2.0:1788869377.356467:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f16680 x1875765324990848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869377.356473:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765324990848:0@lo:400: 00000100:00100000:2.0:1788869377.356481:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324990208:0@lo:400: 00010000:00080000:2.0:1788869377.356489:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f15880 x1875765324990720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869377.356496:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324990720:0@lo:400: 00010000:00080000:2.0:1788869377.356515:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283b473480 x1875765324991232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869377.356522:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788869377.356546:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324991232:0@lo:400: 00000100:00100000:3.0:1788869377.356692:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324989696 00000100:00100000:3.0:1788869377.356697:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324989696 00000100:00100000:3.0:1788869377.356737:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788869377.356744:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765324989696:12345-0@lo:400: 00000100:00100000:3.0:1788869377.356783:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765324989696:12345-0@lo:400: Request processed in 40us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869377.356789:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788869377.356942:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324989696:0@lo:400: 00000100:00100000:3.0:1788869377.861781:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324991360:0@lo:13: 00000100:00100000:3.0:1788869377.861884:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869377.862186:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324991360 00000100:00100000:1.0:1788869377.862199:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324991360 00000100:00100000:1.0:1788869377.862269:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869377.862281:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324991360:12345-0@lo:13: 00002000:00000024:1.0:1788869377.862319:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869377.862381:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324991360:12345-0@lo:13: Request processed in 102us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869377.862388:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869377.862426:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324991488:0@lo:13: 00000100:00100000:1.0:1788869377.862454:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869377.862503:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324991488 00000100:00100000:1.0:1788869377.862507:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324991488 00000100:00100000:1.0:1788869377.862524:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869377.862529:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324991488:12345-0@lo:13: 00002000:00000024:1.0:1788869377.862539:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869377.862568:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324991488:12345-0@lo:13: Request processed in 39us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869377.862611:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788869377.862650:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f2a00 x1875765324991488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869377.862671:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324991488:0@lo:13: 00010000:00080000:2.0:1788869377.862775:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a1180 x1875765324991360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869377.862790:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324991360:0@lo:13: 00000020:00000004:1.0:1788869378.140178:0:10043:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869378.140438:0:10043:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869378.245753:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869379.046432:0:10092:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869379.046443:0:10092:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788869379.273776:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869379.397852:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869379.406045:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324991616:0@lo:41: 00000100:00100000:3.0:1788869379.406169:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869379.406623:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324991616 00000100:00100000:1.0:1788869379.406633:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324991616 00000100:00100000:1.0:1788869379.406691:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869379.406701:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324991616:12345-0@lo:41: 00000004:00000024:1.0:1788869379.406737:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788869379.406804:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324991616:12345-0@lo:41: Request processed in 105us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869379.406811:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788869379.407570:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324991616:0@lo:41: 00000100:00100000:3.0:1788869379.707222:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869379.707603:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305016448 00000100:00100000:2.0:1788869379.707613:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305016448 00000100:00100000:2.0:1788869379.707664:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:2.0:1788869379.707674:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2406:x1875765305016448:12345-192.168.204.54@tcp:250: 00010000:00080000:2.0:1788869379.707702:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 448e652b-ca43-4915-9c32-5166fb543df5@192.168.204.54@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:2.0:1788869379.707859:0:6518:0:(genops.c:1384:class_connect()) connect: client 448e652b-ca43-4915-9c32-5166fb543df5, cookie 0x4c16c38a9b6ce85e 00000100:00080000:2.0:1788869379.708464:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8e282dbab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869379.708719:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+5:2406:x1875765305016448:12345-192.168.204.54@tcp:250: Request processed in 1033us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869379.708729:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:2.0:1788869379.725972:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869379.726285:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305016576 00000100:00100000:3.0:1788869379.726296:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305016576 00000100:00100000:3.0:1788869379.726359:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:3.0:1788869379.726370:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+5:6167:x1875765305016576:12345-192.168.204.54@tcp:101: 00010000:00010000:3.0:1788869379.726403:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869379.726424:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9c29 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869379.726454:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c29 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869379.726467:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c29 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869379.726477:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a9600, rc 0) 00000100:00100000:3.0:1788869379.726549:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+6:6167:x1875765305016576:12345-192.168.204.54@tcp:101: Request processed in 181us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869379.726556:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:0.0:1788869379.732289:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869379.732495:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305016704 00000100:00100000:2.0:1788869379.732507:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305016704 00000100:00100000:2.0:1788869379.732616:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:2.0:1788869379.732626:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+6:6167:x1875765305016704:12345-192.168.204.54@tcp:501: 00000100:00100000:2.0:1788869379.732882:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+6:6167:x1875765305016704:12345-192.168.204.54@tcp:501: Request processed in 256us (611us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869379.732911:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:2.0:1788869379.741997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869379.742223:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305016832 00000100:00100000:0.0:1788869379.742235:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305016832 00000100:00100000:0.0:1788869379.742302:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:0.0:1788869379.742313:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+6:6167:x1875765305016832:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1788869379.742348:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869379.742368:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9c30 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869379.742401:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c30 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869379.742413:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c30 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869379.742425:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5200, rc 0) 00000100:00100000:0.0:1788869379.742834:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+7:6167:x1875765305016832:12345-192.168.204.54@tcp:101: Request processed in 520us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869379.742841:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:0.0:1788869379.749481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869379.749621:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305016960 00000100:00100000:3.0:1788869379.749633:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305016960 00000100:00100000:3.0:1788869379.749697:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:3.0:1788869379.749768:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+7:6167:x1875765305016960:12345-192.168.204.54@tcp:501: 00000100:00100000:3.0:1788869379.750020:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+8:6167:x1875765305016960:12345-192.168.204.54@tcp:501: Request processed in 256us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869379.750029:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:1.0:1788869379.753824:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869379.754054:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305017088 00000100:00100000:0.0:1788869379.754068:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305017088 00000100:00100000:0.0:1788869379.754137:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:0.0:1788869379.754149:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+8:6167:x1875765305017088:12345-192.168.204.54@tcp:503: 00000100:00100000:0.0:1788869379.754356:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+8:6167:x1875765305017088:12345-192.168.204.54@tcp:503: Request processed in 207us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869379.754364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:0.0:1788869379.760989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869379.761147:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305017216 00000100:00100000:2.0:1788869379.761161:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305017216 00000100:00100000:2.0:1788869379.761300:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:2.0:1788869379.761312:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+8:6185:x1875765305017216:12345-192.168.204.54@tcp:502: 00000100:00100000:2.0:1788869379.761521:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+8:6185:x1875765305017216:12345-192.168.204.54@tcp:502: Request processed in 211us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869379.761538:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:2.0:1788869379.810568:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869379.810730:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305017344 00000100:00100000:3.0:1788869379.810740:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305017344 00000100:00100000:3.0:1788869379.810798:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:3.0:1788869379.810808:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+8:6185:x1875765305017344:12345-192.168.204.54@tcp:502: 00000100:00100000:3.0:1788869379.811074:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+8:6185:x1875765305017344:12345-192.168.204.54@tcp:502: Request processed in 268us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869379.811092:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:1.0:1788869379.823645:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869379.824028:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305017472 00000100:00100000:0.0:1788869379.824042:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305017472 00000100:00100000:0.0:1788869379.824121:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:0.0:1788869379.824132:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+8:6167:x1875765305017472:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1788869379.824174:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869379.824196:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6ce873 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9c61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869379.824232:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6ce873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c61 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869379.824244:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6ce873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c61 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869379.824253:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5a00, rc 0) 00000100:00100000:0.0:1788869379.824317:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+9:6167:x1875765305017472:12345-192.168.204.54@tcp:101: Request processed in 187us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869379.824325:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:0.0:1788869379.833676:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869379.833824:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305017600 00000100:00100000:2.0:1788869379.833839:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305017600 00000100:00100000:2.0:1788869379.833916:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:2.0:1788869379.833926:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+9:6167:x1875765305017600:12345-192.168.204.54@tcp:256: 20000000:01000000:2.0:1788869379.834134:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788869379.834166:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788869379.834171:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788869379.834174:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788869379.834177:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788869379.834180:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788869379.837389:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+9:6167:x1875765305017600:12345-192.168.204.54@tcp:256: Request processed in 3452us (3711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869379.837404:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:1.0:1788869379.843330:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869379.843395:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305017728 00000100:00100000:3.0:1788869379.843411:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305017728 00000100:00100000:3.0:1788869379.843485:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:3.0:1788869379.843497:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+9:6167:x1875765305017728:12345-192.168.204.54@tcp:101: 00010000:00010000:3.0:1788869379.843519:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869379.843553:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9c68 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869379.843637:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c68 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869379.843651:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c68 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869379.843660:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8000, rc 0) 00000100:00100000:3.0:1788869379.844483:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:6167:x1875765305017728:12345-192.168.204.54@tcp:101: Request processed in 984us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869379.844493:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:2.0:1788869379.846959:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869379.847200:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305017856 00000100:00100000:0.0:1788869379.847212:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305017856 00000100:00100000:0.0:1788869379.847373:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:0.0:1788869379.847385:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:6167:x1875765305017856:12345-192.168.204.54@tcp:501: 00000100:00100000:0.0:1788869379.847615:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:6167:x1875765305017856:12345-192.168.204.54@tcp:501: Request processed in 200us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869379.847624:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:2.0:1788869379.852720:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869379.852890:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305017984 00000100:00100000:3.0:1788869379.852903:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305017984 00000100:00100000:3.0:1788869379.852978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:3.0:1788869379.852989:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:6167:x1875765305017984:12345-192.168.204.54@tcp:503: 00000100:00100000:3.0:1788869379.853494:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:6167:x1875765305017984:12345-192.168.204.54@tcp:503: Request processed in 504us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869379.853502:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:1.0:1788869379.856448:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869379.856569:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305018112 00000100:00100000:0.0:1788869379.856580:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305018112 00000100:00100000:0.0:1788869379.856686:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:0.0:1788869379.856696:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:6191:x1875765305018112:12345-192.168.204.54@tcp:502: 00000100:00100000:0.0:1788869379.856862:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:6191:x1875765305018112:12345-192.168.204.54@tcp:502: Request processed in 166us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869379.856870:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:2.0:1788869379.859873:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869379.861854:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305018240 00000100:00100000:3.0:1788869379.861967:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305018240 00000100:00100000:3.0:1788869379.862690:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:3.0:1788869379.862774:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:6191:x1875765305018240:12345-192.168.204.54@tcp:502: 00000100:00100000:3.0:1788869379.863242:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:6191:x1875765305018240:12345-192.168.204.54@tcp:502: Request processed in 539us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869379.864391:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:2.0:1788869379.869014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869379.869060:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869379.869138:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305018368 00000100:00100000:3.0:1788869379.869149:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305018368 00000100:00100000:3.0:1788869379.869195:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305018624 00000100:00100000:3.0:1788869379.869198:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305018624 00000100:00100000:3.0:1788869379.869218:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788869379.869229:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1875765305018368:12345-192.168.204.54@tcp:38: 00010000:00080000:3.0:1788869379.869268:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:3.0:1788869379.869333:0:6525:0:(genops.c:1384:class_connect()) connect: client 91cba2f3-33fb-476e-a4a1-b4fbee1b176d, cookie 0x4c16c38a9b6ce881 00000100:00100000:1.0:1788869379.869338:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1788869379.869343:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875765305018624:12345-192.168.204.54@tcp:38: 00000004:00100000:3.0:1788869379.869360:0:6525:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00080000:1.0:1788869379.869361:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:1.0:1788869379.869394:0:6526:0:(genops.c:1384:class_connect()) connect: client 91cba2f3-33fb-476e-a4a1-b4fbee1b176d, cookie 0x4c16c38a9b6ce888 00000004:00100000:1.0:1788869379.869406:0:6526:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788869379.869608:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8e2703410000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788869379.869608:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8e2703a1d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869379.869684:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2406:x1875765305018368:12345-192.168.204.54@tcp:38: Request processed in 455us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869379.869692:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788869379.869981:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2406:x1875765305018624:12345-192.168.204.54@tcp:38: Request processed in 634us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869379.869988:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:1.0:1788869380.294435:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869380.422140:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324991744:0@lo:13: 00000100:00100000:2.0:1788869380.422264:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869380.422613:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324991744 00000100:00100000:0.0:1788869380.422623:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324991744 00000100:00100000:0.0:1788869380.422708:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869380.422718:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324991744:12345-0@lo:13: 00002000:00000024:0.0:1788869380.422747:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869380.422791:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324991744:12345-0@lo:13: Request processed in 77us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869380.422798:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788869380.423225:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869380.423267:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a33800 x1875765324991744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869380.423287:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324991744:0@lo:13: 00000100:00100000:0.0:1788869380.438000:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869380.438037:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324991872:0@lo:13: 00000100:00100000:0.0:1788869380.438150:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869380.439985:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324991872 00000100:00100000:3.0:1788869380.439998:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324991872 00000100:00100000:3.0:1788869380.440089:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869380.440106:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324991872:12345-0@lo:13: 00002000:00000024:3.0:1788869380.440134:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869380.440204:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324991872:12345-0@lo:13: Request processed in 101us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869380.440212:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788869380.440401:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869380.440851:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044a80 x1875765324991872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869380.440889:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324991872:0@lo:13: 00000100:00100000:1.0:1788869380.893832:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869380.893892:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869380.894001:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305018496 00000100:00100000:0.0:1788869380.894025:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305018496 00000100:00100000:0.0:1788869380.894143:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305018880 00000100:00100000:0.0:1788869380.894147:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305018880 00000100:00100000:0.0:1788869380.894170:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788869380.894183:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:0:x1875765305018496:12345-192.168.204.54@tcp:41: 00000004:00000024:0.0:1788869380.894234:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788869380.894337:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:0:x1875765305018496:12345-192.168.204.54@tcp:41: Request processed in 157us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869380.894345:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788869380.894365:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1788869380.894373:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6167:x1875765305018880:12345-192.168.204.54@tcp:41: 00000004:00000024:0.0:1788869380.894384:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788869380.894406:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6167:x1875765305018880:12345-192.168.204.54@tcp:41: Request processed in 34us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869380.894412:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:1.0:1788869380.894989:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869380.898004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869380.898580:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305018752 00000100:00100000:0.0:1788869380.898640:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305018752 00000100:00100000:0.0:1788869380.898794:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788869380.898807:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:0:x1875765305018752:12345-192.168.204.54@tcp:41: 00000004:00000024:0.0:1788869380.898852:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869380.898938:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:0:x1875765305018752:12345-192.168.204.54@tcp:41: Request processed in 134us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869380.898947:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1788869380.904994:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869380.905147:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305019008 00000100:00100000:3.0:1788869380.905158:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305019008 00000100:00100000:3.0:1788869380.905226:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869380.905237:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6167:x1875765305019008:12345-192.168.204.54@tcp:40: 00000100:00100000:3.0:1788869380.905406:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6167:x1875765305019008:12345-192.168.204.54@tcp:40: Request processed in 171us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869380.905414:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00080000:1.0:1788869380.907275:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869380.914255:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869380.914381:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869380.914424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869380.914454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869380.914557:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305019520 00000100:00100000:1.0:1788869380.914569:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305019520 00000100:00100000:1.0:1788869380.914658:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:1.0:1788869380.914668:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:2409:x1875765305019520:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788869380.914737:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:2409:x1875765305019520:12345-192.168.204.54@tcp:400: Request processed in 71us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869380.914745:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:2.0:1788869380.916687:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305019136 00000100:00100000:2.0:1788869380.916701:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305019136 00000100:00100000:2.0:1788869380.916758:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305019264 00000100:00100000:2.0:1788869380.916762:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305019264 00000100:00100000:2.0:1788869380.916787:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788869380.916795:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1875765305019136:12345-192.168.204.54@tcp:8: 00010000:00080000:2.0:1788869380.916830:0:8743:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1788869380.916872:0:8743:0:(genops.c:1384:class_connect()) connect: client 91cba2f3-33fb-476e-a4a1-b4fbee1b176d, cookie 0x4c16c38a9b6ce88f 00002000:00100000:2.0:1788869380.916884:0:8743:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 91cba2f3-33fb-476e-a4a1-b4fbee1b176d/ffff8e282dbaa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869380.916895:0:8743:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788869380.917121:0:8743:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788869380.917159:0:8743:0:(import.c:65:import_set_state_nolock()) ffff8e283b46e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869380.917223:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2406:x1875765305019136:12345-192.168.204.54@tcp:8: Request processed in 427us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869380.917231:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788869380.917251:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788869380.917256:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1875765305019264:12345-192.168.204.54@tcp:8: 00010000:00080000:2.0:1788869380.917273:0:8743:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1788869380.917801:0:8743:0:(genops.c:1384:class_connect()) connect: client 91cba2f3-33fb-476e-a4a1-b4fbee1b176d, cookie 0x4c16c38a9b6ce896 00002000:00100000:2.0:1788869380.917808:0:8743:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 91cba2f3-33fb-476e-a4a1-b4fbee1b176d/ffff8e2702742800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869380.917823:0:8743:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788869380.918050:0:8743:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788869380.918076:0:8743:0:(import.c:65:import_set_state_nolock()) ffff8e2702745800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869380.918114:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2406:x1875765305019264:12345-192.168.204.54@tcp:8: Request processed in 857us (3658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869380.918121:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1788869380.926438:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305019392 00000100:00100000:0.0:1788869380.926456:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305019392 00000100:00100000:0.0:1788869380.926545:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788869380.926557:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6167:x1875765305019392:12345-192.168.204.54@tcp:900: 00000100:00100000:0.0:1788869380.926672:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6167:x1875765305019392:12345-192.168.204.54@tcp:900: Request processed in 117us (12428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869380.926990:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788869380.952727:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869380.952973:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305019648 00000100:00100000:1.0:1788869380.952986:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305019648 00000100:00100000:1.0:1788869380.953048:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788869380.953059:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6167:x1875765305019648:12345-192.168.204.54@tcp:33: 00000004:00080000:2.0:1788869381.012997:0:6527:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 56775us 00000004:00200000:0.0:1788869381.043801:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788869381.044093:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6167:x1875765305019648:12345-192.168.204.54@tcp:33: Request processed in 91031us (91373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869381.044121:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788869381.290752:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869381.290875:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305019776 00000100:00100000:0.0:1788869381.290887:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305019776 00000100:00100000:0.0:1788869381.290961:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788869381.290971:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6209:x1875765305019776:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1788869381.290992:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869381.292468:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6ce89d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9c99 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869381.292649:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ce8a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869381.292664:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ce8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869381.292680:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ce8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869381.292737:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869381.292741:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869381.292760:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ce8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869381.292793:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6ce89d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c99 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869381.292813:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ce8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c99 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869381.292840:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803eb7100) 00010000:00010000:0.0:1788869381.292844:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869381.292848:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4200, rc 0) 00000100:00100000:0.0:1788869381.293007:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:6209:x1875765305019776:12345-192.168.204.54@tcp:101: Request processed in 2028us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869381.293017:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00010000:00010000:0.0:1788869381.317769:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869381.448866:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324992000:0@lo:41: 00000100:00100000:3.0:1788869381.448967:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869381.449162:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324992000 00000100:00100000:2.0:1788869381.449171:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324992000 00000100:00100000:2.0:1788869381.449241:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788869381.449251:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324992000:12345-0@lo:41: 00000004:00000024:2.0:1788869381.449291:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869381.449358:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324992000:12345-0@lo:41: Request processed in 108us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869381.449366:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788869381.449459:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324992000:0@lo:41: 00010000:00010000:0.0:1788869382.341762:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869382.470359:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324992384:0@lo:400: 00000100:00100000:3.0:1788869382.470454:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869382.470520:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324992896:0@lo:400: 00000100:00100000:3.0:1788869382.470547:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869382.470565:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765324993408:0@lo:400: 00000100:00100000:3.0:1788869382.471086:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869382.471132:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788869382.471139:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324992256:0@lo:400: 00000100:00100000:3.0:1788869382.471169:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869382.471186:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765324992768:0@lo:400: 00000100:00100000:3.0:1788869382.471206:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869382.471228:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765324993280:0@lo:400: 00000100:00100000:3.0:1788869382.471265:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869382.471297:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324992384 00000100:00100000:3.0:1788869382.471306:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324992384 00000100:00100000:3.0:1788869382.471350:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869382.471359:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324992384:12345-0@lo:400: 00000100:00100000:3.0:1788869382.471415:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324992384:12345-0@lo:400: Request processed in 58us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869382.471423:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869382.471445:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324992896 00000100:00100000:3.0:1788869382.471449:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324992896 00000100:00100000:3.0:1788869382.471480:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324993408 00000100:00100000:3.0:1788869382.471483:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324993408 00000100:00100000:3.0:1788869382.471498:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324992256 00000100:00100000:3.0:1788869382.471501:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324992256 00000100:00100000:3.0:1788869382.471510:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324992768 00000100:00100000:3.0:1788869382.471513:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324992768 00000100:00100000:3.0:1788869382.471524:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324993280 00000100:00100000:3.0:1788869382.471526:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324993280 00000100:00100000:3.0:1788869382.471541:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869382.471548:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324992896:12345-0@lo:400: 00000100:00100000:3.0:1788869382.471578:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324992896:12345-0@lo:400: Request processed in 31us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869382.471625:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869382.471638:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788869382.471644:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765324993408:12345-0@lo:400: 00000100:00100000:3.0:1788869382.471681:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765324993408:12345-0@lo:400: Request processed in 38us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869382.471699:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788869382.471709:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869382.471721:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324992256:12345-0@lo:400: 00000100:00100000:3.0:1788869382.471751:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765324992256:12345-0@lo:400: Request processed in 30us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869382.471757:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869382.471766:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788869382.471772:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765324992768:12345-0@lo:400: 00000100:00100000:3.0:1788869382.471792:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765324992768:12345-0@lo:400: Request processed in 21us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869382.471797:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788869382.471806:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788869382.471811:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765324993280:12345-0@lo:400: 00000100:00100000:3.0:1788869382.471830:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765324993280:12345-0@lo:400: Request processed in 20us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869382.471835:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788869382.471873:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765324992256:0@lo:400: 00000100:00100000:3.0:1788869382.471895:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765324992768:0@lo:400: 00000100:00100000:3.0:1788869382.471906:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765324993280:0@lo:400: 00000100:00100000:3.0:1788869382.471917:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324992384:0@lo:400: 00010000:00080000:3.0:1788869382.471930:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044700 x1875765324992896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869382.471942:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324992896:0@lo:400: 00010000:00080000:3.0:1788869382.471952:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f045c00 x1875765324993408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869382.471972:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765324993408:0@lo:400: 00000100:00100000:0.0:1788869382.472527:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324992512:0@lo:400: 00000100:00100000:0.0:1788869382.472574:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869382.472989:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324993024:0@lo:400: 00000100:00100000:0.0:1788869382.473018:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869382.473043:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324993536:0@lo:400: 00000100:00100000:0.0:1788869382.473064:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869382.473095:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788869382.473102:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324992128:0@lo:400: 00000100:00100000:0.0:1788869382.473138:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869382.473158:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324992640:0@lo:400: 00000100:00100000:0.0:1788869382.473185:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869382.473210:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324993152:0@lo:400: 00000100:00100000:0.0:1788869382.473232:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869382.473248:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324993664:0@lo:400: 00000100:00100000:0.0:1788869382.473293:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869382.473329:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324992640 00000100:00100000:0.0:1788869382.473338:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324992640 00000100:00100000:0.0:1788869382.473383:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788869382.473392:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324992640:12345-0@lo:400: 00000100:00100000:0.0:1788869382.473442:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324992640:12345-0@lo:400: Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869382.473449:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788869382.473485:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324992640:0@lo:400: 00000100:00080000:1.0:1788869382.473990:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869382.473998:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869382.474012:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324993024 00000100:00100000:1.0:1788869382.474026:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324993024 00000100:00100000:1.0:1788869382.474082:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324993536 00000100:00100000:1.0:1788869382.474086:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324993536 00000100:00100000:1.0:1788869382.474271:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324993152 00000100:00100000:1.0:1788869382.474275:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324993152 00000100:00100000:2.0:1788869382.474394:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324993664 00000100:00100000:2.0:1788869382.474398:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324993664 00000100:00100000:2.0:1788869382.474424:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869382.474432:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324993024:12345-0@lo:400: 00000100:00100000:2.0:1788869382.474517:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324993024:12345-0@lo:400: Request processed in 86us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869382.474524:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869382.474556:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869382.474562:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324993536:12345-0@lo:400: 00000100:00100000:2.0:1788869382.474641:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324993536:12345-0@lo:400: Request processed in 80us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869382.474648:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869382.474662:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869382.474668:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324993664:12345-0@lo:400: 00000100:00100000:2.0:1788869382.474697:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324993664:12345-0@lo:400: Request processed in 28us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869382.474702:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869382.474731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324992128 00000100:00100000:2.0:1788869382.474736:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324992128 00000100:00100000:2.0:1788869382.474766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788869382.474779:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765324992128:12345-0@lo:400: 00000100:00100000:2.0:1788869382.474808:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765324992128:12345-0@lo:400: Request processed in 31us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869382.474814:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788869382.475059:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869382.475067:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324993152:12345-0@lo:400: 00000100:00100000:1.0:1788869382.475106:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324993152:12345-0@lo:400: Request processed in 40us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869382.475113:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869382.477089:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324992512 00000100:00100000:3.0:1788869382.477114:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324992512 00000100:00100000:3.0:1788869382.477198:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788869382.477208:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324992512:12345-0@lo:400: 00000100:00100000:3.0:1788869382.477293:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765324992512:12345-0@lo:400: Request processed in 88us (4717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869382.477300:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788869382.477576:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869382.477583:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869382.477652:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324992128:0@lo:400: 00010000:00080000:0.0:1788869382.477671:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f047b80 x1875765324993152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869382.477684:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324993152:0@lo:400: 00010000:00080000:0.0:1788869382.477695:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044a80 x1875765324993664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869382.477703:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324993664:0@lo:400: 00000100:00100000:0.0:1788869382.477716:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765324992512:0@lo:400: 00010000:00080000:0.0:1788869382.477728:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f045500 x1875765324993024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869382.477736:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324993024:0@lo:400: 00010000:00080000:0.0:1788869382.477753:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044000 x1875765324993536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869382.477780:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324993536:0@lo:400: 00000100:00100000:0.0:1788869382.982769:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324993792:0@lo:13: 00000100:00100000:0.0:1788869382.982863:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869382.982962:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869382.982969:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324993920:0@lo:13: 00000100:00100000:0.0:1788869382.982995:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869382.983032:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324993792 00000100:00100000:0.0:1788869382.983041:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324993792 00000100:00100000:0.0:1788869382.983084:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324993920 00000100:00100000:0.0:1788869382.983087:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324993920 00000100:00100000:0.0:1788869382.983102:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869382.983110:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324993792:12345-0@lo:13: 00002000:00000024:0.0:1788869382.983159:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869382.983206:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324993792:12345-0@lo:13: Request processed in 97us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869382.983213:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869382.983230:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869382.983237:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324993920:12345-0@lo:13: 00002000:00000024:0.0:1788869382.983247:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869382.983270:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324993920:12345-0@lo:13: Request processed in 33us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869382.983275:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788869382.983308:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d6a00 x1875765324993920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869382.983329:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324993920:0@lo:13: 00010000:00080000:0.0:1788869382.983353:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f3480 x1875765324993792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869382.983365:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324993792:0@lo:13: 00010000:00010000:1.0:1788869383.365989:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869383.594763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869383.598927:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305019904 00000100:00100000:3.0:1788869383.598953:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305019904 00000100:00100000:3.0:1788869383.599057:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788869383.599069:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:6262:x1875765305019904:12345-192.168.204.54@tcp:41: 00000004:00000024:3.0:1788869383.599118:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788869383.599574:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:6262:x1875765305019904:12345-192.168.204.54@tcp:41: Request processed in 506us (4820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869383.599582:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00080000:0.0:1788869383.601172:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869383.601915:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869383.602001:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305020032 00000100:00100000:3.0:1788869383.602011:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305020032 00000100:00100000:3.0:1788869383.602081:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1788869383.602091:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6262:x1875765305020032:12345-192.168.204.54@tcp:41: 00000004:00000024:3.0:1788869383.602132:0:8260:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869383.602212:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6262:x1875765305020032:12345-192.168.204.54@tcp:41: Request processed in 123us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869383.602220:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00080000:0.0:1788869383.602799:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869383.608972:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869383.609092:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305020160 00000100:00100000:0.0:1788869383.609109:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305020160 00000100:00100000:0.0:1788869383.609208:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788869383.609219:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6262:x1875765305020160:12345-192.168.204.54@tcp:13: 00002000:00000024:0.0:1788869383.609252:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869383.609325:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6262:x1875765305020160:12345-192.168.204.54@tcp:13: Request processed in 108us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869383.609332:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00080000:1.0:1788869383.610214:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869383.615954:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869383.616516:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305020288 00000100:00100000:0.0:1788869383.616532:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305020288 00000100:00100000:0.0:1788869383.616666:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788869383.616679:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6262:x1875765305020288:12345-192.168.204.54@tcp:13: 00002000:00000024:0.0:1788869383.616706:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869383.616780:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:6262:x1875765305020288:12345-192.168.204.54@tcp:13: Request processed in 104us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869383.616788:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00080000:1.0:1788869383.616873:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788869384.391490:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869384.517935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324994048:0@lo:41: 00000100:00100000:0.0:1788869384.518021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869384.518247:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324994048 00000100:00100000:1.0:1788869384.518261:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324994048 00000100:00100000:1.0:1788869384.518330:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788869384.518341:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324994048:12345-0@lo:41: 00000004:00000024:1.0:1788869384.518386:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788869384.518658:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765324994048:12345-0@lo:41: Request processed in 316us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869384.518667:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788869384.518793:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765324994048:0@lo:41: 00000001:00100000:2.0:1788869385.038816:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00010000:00010000:2.0:1788869385.417171:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869385.545352:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324994176:0@lo:13: 00000100:00100000:0.0:1788869385.545461:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869385.547078:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324994304:0@lo:13: 00000100:00100000:1.0:1788869385.547169:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869385.547449:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324994176 00000100:00100000:2.0:1788869385.547460:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324994176 00000100:00100000:2.0:1788869385.547521:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324994304 00000100:00100000:2.0:1788869385.547524:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324994304 00000100:00100000:2.0:1788869385.547542:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869385.547550:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324994176:12345-0@lo:13: 00002000:00000024:2.0:1788869385.547610:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869385.547668:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324994176:12345-0@lo:13: Request processed in 118us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869385.547690:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869385.547706:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869385.547712:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324994304:12345-0@lo:13: 00002000:00000024:2.0:1788869385.547722:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869385.547750:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324994304:12345-0@lo:13: Request processed in 38us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869385.547755:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788869385.548538:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d4380 x1875765324994176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869385.548559:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324994176:0@lo:13: 00000100:00080000:1.0:1788869385.552491:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869385.552582:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d5880 x1875765324994304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869385.552658:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324994304:0@lo:13: 00000001:00100000:3.0:1788869386.055624:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000001:00100000:3.0:1788869386.061511:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000100:00100000:2.0:1788869386.170202:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869386.170244:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869386.170276:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869386.170296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869386.170325:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869386.170355:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305020544 00000100:00100000:2.0:1788869386.170366:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305020544 00000100:00100000:2.0:1788869386.170435:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305020672 00000100:00100000:2.0:1788869386.170439:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305020672 00000100:00100000:2.0:1788869386.170465:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1788869386.170476:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305020544:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1788869386.170553:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305020544:12345-192.168.204.54@tcp:400: Request processed in 79us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869386.170560:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1788869386.170578:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1788869386.170621:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305020672:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1788869386.170650:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305020672:12345-192.168.204.54@tcp:400: Request processed in 65us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869386.170656:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1788869386.170690:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305020800 00000100:00100000:2.0:1788869386.170694:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305020800 00000100:00100000:2.0:1788869386.170720:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305020928 00000100:00100000:2.0:1788869386.170723:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305020928 00000100:00100000:2.0:1788869386.170744:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788869386.170750:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305020800:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1788869386.170776:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305020800:12345-192.168.204.54@tcp:400: Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869386.170783:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788869386.170794:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788869386.170810:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305020928:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1788869386.170833:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305020928:12345-192.168.204.54@tcp:400: Request processed in 35us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869386.170838:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00080000:2.0:1788869386.170853:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869386.170856:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869386.170859:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869386.170861:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869386.171423:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305020416 00000100:00100000:3.0:1788869386.171431:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305020416 00000100:00100000:3.0:1788869386.171490:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:3.0:1788869386.171498:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305020416:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1788869386.171550:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305020416:12345-192.168.204.54@tcp:400: Request processed in 52us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869386.171556:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 198 00010000:00010000:3.0:1788869386.443980:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869386.568564:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324994432:0@lo:41: 00000100:00100000:0.0:1788869386.568673:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869386.568758:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324994432 00000100:00100000:0.0:1788869386.568767:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324994432 00000100:00100000:0.0:1788869386.568843:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788869386.568853:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324994432:12345-0@lo:41: 00000004:00000024:0.0:1788869386.568897:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869386.568952:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765324994432:12345-0@lo:41: Request processed in 100us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869386.568958:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788869386.569010:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765324994432:0@lo:41: 00000001:02000400:3.0:1788869386.870228:0:10190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788869387.091659:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00010000:00010000:0.0:1788869387.462625:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869387.590421:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324994944:0@lo:400: 00000100:00100000:0.0:1788869387.590509:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869387.590577:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324995456:0@lo:400: 00000100:00100000:0.0:1788869387.590638:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869387.590663:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324995968:0@lo:400: 00000100:00100000:0.0:1788869387.590687:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869387.590728:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788869387.590735:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324994816:0@lo:400: 00000100:00100000:0.0:1788869387.590787:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869387.590811:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324995328:0@lo:400: 00000100:00100000:0.0:1788869387.590834:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869387.590850:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765324995840:0@lo:400: 00000100:00100000:0.0:1788869387.590871:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869387.590896:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324994688:0@lo:400: 00000100:00100000:0.0:1788869387.590917:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324994816 00000100:00100000:0.0:1788869387.590925:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324994816 00000100:00100000:2.0:1788869387.590937:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869387.590961:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765324995200:0@lo:400: 00000100:00100000:0.0:1788869387.590981:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869387.590987:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869387.590994:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324994816:12345-0@lo:400: 00000100:00100000:2.0:1788869387.591001:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765324995712:0@lo:400: 00000100:00100000:2.0:1788869387.591026:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869387.591049:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788869387.591056:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324994560:0@lo:400: 00000100:00100000:0.0:1788869387.591062:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324994816:12345-0@lo:400: Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869387.591075:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869387.591101:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869387.591129:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324994816:0@lo:400: 00000100:00100000:2.0:1788869387.591148:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324995072:0@lo:400: 00000100:00100000:2.0:1788869387.591172:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869387.591178:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324995456 00000100:00100000:0.0:1788869387.591183:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324995456 00000100:00100000:2.0:1788869387.591189:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324995584:0@lo:400: 00000100:00100000:2.0:1788869387.591216:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869387.591239:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324996096:0@lo:400: 00000100:00100000:2.0:1788869387.591259:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869387.591313:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324994944 00000100:00100000:3.0:1788869387.591318:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324994944 00000100:00100000:3.0:1788869387.591341:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324995328 00000100:00100000:3.0:1788869387.591344:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324995328 00000100:00100000:3.0:1788869387.591357:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324995840 00000100:00100000:3.0:1788869387.591359:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324995840 00000100:00100000:3.0:1788869387.591371:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324994688 00000100:00100000:3.0:1788869387.591374:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324994688 00000100:00100000:3.0:1788869387.591385:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324995200 00000100:00100000:3.0:1788869387.591388:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324995200 00000100:00100000:3.0:1788869387.591399:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324995712 00000100:00100000:3.0:1788869387.591401:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324995712 00000100:00100000:3.0:1788869387.591416:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869387.591423:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324994944:12345-0@lo:400: 00000100:00100000:3.0:1788869387.591465:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765324994944:12345-0@lo:400: Request processed in 43us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869387.591471:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869387.591485:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869387.591491:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324995328:12345-0@lo:400: 00000100:00100000:3.0:1788869387.591529:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765324995328:12345-0@lo:400: Request processed in 39us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869387.591536:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869387.591548:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788869387.591554:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765324995840:12345-0@lo:400: 00000100:00100000:3.0:1788869387.591578:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765324995840:12345-0@lo:400: Request processed in 25us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869387.591583:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788869387.591615:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869387.591621:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324994688:12345-0@lo:400: 00000100:00100000:3.0:1788869387.591647:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324994688:12345-0@lo:400: Request processed in 27us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869387.591653:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869387.591665:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788869387.591671:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765324995200:12345-0@lo:400: 00000100:00100000:3.0:1788869387.591695:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765324995200:12345-0@lo:400: Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869387.591701:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788869387.591711:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788869387.591716:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765324995712:12345-0@lo:400: 00000100:00100000:3.0:1788869387.591738:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765324995712:12345-0@lo:400: Request processed in 23us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869387.591743:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788869387.591760:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324995072 00000100:00100000:3.0:1788869387.591765:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324995072 00000100:00100000:3.0:1788869387.591799:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788869387.591812:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324995072:12345-0@lo:400: 00000100:00100000:3.0:1788869387.591841:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324995072:12345-0@lo:400: Request processed in 31us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869387.591847:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788869387.591880:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111c700 x1875765324995328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869387.591891:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765324995328:0@lo:400: 00010000:00080000:3.0:1788869387.591900:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111dc00 x1875765324995840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869387.591909:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765324995840:0@lo:400: 00000100:00100000:3.0:1788869387.591919:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765324994944:0@lo:400: 00000100:00100000:3.0:1788869387.591957:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324994560 00000100:00100000:3.0:1788869387.591961:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324994560 00000100:00100000:3.0:1788869387.591985:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788869387.591992:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765324994560:12345-0@lo:400: 00000100:00100000:3.0:1788869387.592022:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765324994560:12345-0@lo:400: Request processed in 30us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869387.592028:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788869387.595569:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324995968 00000100:00100000:0.0:1788869387.595599:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324995968 00000100:00100000:0.0:1788869387.595677:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324995584 00000100:00100000:0.0:1788869387.595680:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324995584 00000100:00100000:0.0:1788869387.595712:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869387.595723:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324995456:12345-0@lo:400: 00000100:00100000:0.0:1788869387.595850:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324995456:12345-0@lo:400: Request processed in 128us (5210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869387.595858:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869387.595875:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869387.595881:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324995968:12345-0@lo:400: 00000100:00100000:0.0:1788869387.596040:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324995968:12345-0@lo:400: Request processed in 159us (5352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869387.596047:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869387.596060:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869387.596066:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324995584:12345-0@lo:400: 00000100:00100000:0.0:1788869387.596096:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324995584:12345-0@lo:400: Request processed in 31us (4880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869387.596103:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788869387.596156:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111d500 x1875765324995456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869387.596173:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324995456:0@lo:400: 00010000:00080000:0.0:1788869387.596186:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111c000 x1875765324995968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869387.596195:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324995968:0@lo:400: 00000100:00080000:0.0:1788869387.596249:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869387.596254:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869387.596257:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869387.596260:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869387.609171:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324994688:0@lo:400: 00000100:00100000:2.0:1788869387.609194:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765324995200:0@lo:400: 00000100:00100000:2.0:1788869387.609217:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765324995712:0@lo:400: 00000100:00100000:2.0:1788869387.609246:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324994560:0@lo:400: 00000100:00100000:2.0:1788869387.609258:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324995072:0@lo:400: 00010000:00080000:2.0:1788869387.609732:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111fb80 x1875765324995584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869387.609744:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324995584:0@lo:400: 00000100:00100000:0.0:1788869387.611181:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324996096 00000100:00100000:0.0:1788869387.611199:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324996096 00000100:00100000:0.0:1788869387.611303:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869387.611314:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324996096:12345-0@lo:400: 00000100:00100000:0.0:1788869387.611416:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765324996096:12345-0@lo:400: Request processed in 104us (20155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869387.611424:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788869387.611998:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788869387.612046:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111ca80 x1875765324996096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869387.612063:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765324996096:0@lo:400: 00000100:00100000:3.0:1788869388.105751:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869388.105794:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324996224:0@lo:13: 00000100:00100000:3.0:1788869388.105870:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869388.105951:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324996224 00000100:00100000:3.0:1788869388.105960:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324996224 00000100:00100000:3.0:1788869388.106013:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869388.106022:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324996224:12345-0@lo:13: 00002000:00000024:3.0:1788869388.106069:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869388.106115:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324996224:12345-0@lo:13: Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869388.106123:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788869388.106164:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d4700 x1875765324996224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869388.106182:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324996224:0@lo:13: 00000100:00100000:2.0:1788869388.106430:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869388.106441:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324996352:0@lo:13: 00000100:00100000:2.0:1788869388.106472:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869388.110498:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324996352 00000100:00100000:3.0:1788869388.110527:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324996352 00000100:00100000:3.0:1788869388.110634:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869388.110647:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324996352:12345-0@lo:13: 00002000:00000024:3.0:1788869388.110677:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869388.110804:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324996352:12345-0@lo:13: Request processed in 161us (4330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869388.110812:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788869388.110885:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c6a00 x1875765324996352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869388.110907:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324996352:0@lo:13: 00010000:00010000:1.0:1788869388.488311:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869389.518978:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869389.641944:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324996480:0@lo:41: 00000100:00100000:0.0:1788869389.642049:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869389.642184:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324996480 00000100:00100000:1.0:1788869389.642194:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324996480 00000100:00100000:1.0:1788869389.642264:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788869389.642275:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324996480:12345-0@lo:41: 00000004:00000024:1.0:1788869389.642325:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788869389.661269:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765324996480:12345-0@lo:41: Request processed in 18980us (19204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869389.661287:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869389.663794:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765324996480:0@lo:41: 00010000:00010000:0.0:1788869390.536635:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869390.663371:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869390.663400:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324996608:0@lo:13: 00000100:00100000:0.0:1788869390.663468:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869390.663535:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324996608 00000100:00100000:0.0:1788869390.663543:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324996608 00000100:00100000:0.0:1788869390.663611:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869390.663622:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324996608:12345-0@lo:13: 00002000:00000024:0.0:1788869390.663651:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869390.663687:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765324996608:12345-0@lo:13: Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869390.663693:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788869390.663724:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869390.663906:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f08000 x1875765324996608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869390.663932:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765324996608:0@lo:13: 00000100:00100000:1.0:1788869390.665132:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869390.665150:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324996736:0@lo:13: 00000100:00100000:1.0:1788869390.665226:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869390.665357:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324996736 00000100:00100000:3.0:1788869390.665364:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324996736 00000100:00100000:3.0:1788869390.665424:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869390.665432:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324996736:12345-0@lo:13: 00002000:00000024:3.0:1788869390.665451:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869390.665494:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765324996736:12345-0@lo:13: Request processed in 62us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869390.665500:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788869390.665538:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d4700 x1875765324996736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869390.665573:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765324996736:0@lo:13: 00000100:00080000:1.0:1788869390.666136:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788869391.099249:0:10337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6c219160 20000000:00000080:1.0:1788869391.099269:0:10337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2703a36c00 uarg=0000000000000000 20000000:01000000:1.0:1788869391.099309:0:10337:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788869391.099312:0:10337:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788869391.099314:0:10337:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788869391.099319:0:10337:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788869391.099324:0:10337:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788869391.099386:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788869391.099388:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788869391.100407:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788869391.100772:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788869391.100800:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788869391.100827:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1788869391.100988:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788869391.100992:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788869391.101430:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788869391.101781:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788869391.102024:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788869391.102048:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788869391.102069:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788869391.102071:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788869391.102362:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788869391.102500:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788869391.102518:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788869391.102530:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788869391.102539:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788869391.102541:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788869391.103293:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788869391.103482:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788869391.103507:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788869391.103525:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788869391.103538:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788869391.103541:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788869391.104466:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788869391.105009:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788869391.105038:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788869391.105075:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:2.0:1788869391.105110:0:10337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788869391.105131:0:10337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105150:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce73f expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105158:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce769 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105165:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7a8 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105179:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7b6 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105185:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7c4 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105192:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7e0 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105200:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce80a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105207:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce826 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105214:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce850 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105223:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c29 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105231:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c30 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105238:0:10337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105279:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c30 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105307:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c30 expref: 9 pid: 6519 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.105323:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324996864:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869391.105479:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c29 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105488:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c29 expref: 9 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.105497:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324996992:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869391.105530:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce850 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105538:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce850 expref: 23 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.105547:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997120:0@lo:104: 00000100:00100000:2.0:1788869391.105623:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869391.105678:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce826 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105703:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce826 expref: 23 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.105713:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997248:0@lo:104: 00000100:00100000:2.0:1788869391.105737:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869391.105772:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce80a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105781:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce80a expref: 23 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.105789:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997376:0@lo:104: 00000100:00100000:2.0:1788869391.105809:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869391.105967:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce7e0 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.105977:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7e0 expref: 23 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.105985:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997504:0@lo:104: 00000100:00100000:2.0:1788869391.106011:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869391.106028:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce7c4 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.106036:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7c4 expref: 23 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.106045:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997632:0@lo:104: 00010000:00010000:2.0:1788869391.106067:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce7b6 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.106076:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7b6 expref: 23 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.106084:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997760:0@lo:104: 00010000:00010000:2.0:1788869391.106126:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce7a8 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.106135:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7a8 expref: 23 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.106144:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997888:0@lo:104: 00010000:00010000:2.0:1788869391.106171:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce769 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.106180:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce769 expref: 23 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.106187:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324998016:0@lo:104: 00010000:00010000:2.0:1788869391.106212:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce73f expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.106220:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce73f expref: 23 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.106227:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324998144:0@lo:104: 00000100:00100000:2.0:1788869391.106244:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a41df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869391.106327:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788869391.106346:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.106359:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.106368:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.106375:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.106383:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.106392:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324997120 00000100:00100000:0.0:1788869391.106398:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324997120 00000100:00100000:0.0:1788869391.106436:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324997248 00000100:00100000:0.0:1788869391.106440:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324997248 00000100:00100000:0.0:1788869391.106460:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324997376 00000100:00100000:0.0:1788869391.106463:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324997376 00000100:00100000:0.0:1788869391.106474:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324997504 00000100:00100000:0.0:1788869391.106476:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324997504 00000100:00100000:0.0:1788869391.106485:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324997632 00000100:00100000:0.0:1788869391.106488:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324997632 00000100:00100000:0.0:1788869391.106496:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324997760 00000100:00100000:0.0:1788869391.106499:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324997760 00000100:00100000:0.0:1788869391.106507:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324997888 00000100:00100000:0.0:1788869391.106509:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324997888 00000100:00100000:0.0:1788869391.106517:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324998016 00000100:00100000:0.0:1788869391.106519:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324998016 00000100:00100000:0.0:1788869391.106540:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324998144 00000100:00100000:0.0:1788869391.106543:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324998144 00000100:00100000:0.0:1788869391.106557:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869391.106566:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:10337:x1875765324997120:12345-0@lo:104: 00010000:00010000:0.0:1788869391.106580:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.106665:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869391.106673:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+11:10337:x1875765324997120:12345-0@lo:104: Request processed in 108us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.106679:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869391.106707:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869391.106713:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:10337:x1875765324997248:12345-0@lo:104: 00010000:00010000:0.0:1788869391.106721:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.106755:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788869391.106760:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+10:10337:x1875765324997248:12345-0@lo:104: Request processed in 49us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.106776:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869391.106789:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869391.106795:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:10337:x1875765324997376:12345-0@lo:104: 00010000:00010000:0.0:1788869391.106802:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.106854:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788869391.106860:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+9:10337:x1875765324997376:12345-0@lo:104: Request processed in 65us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.106865:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869391.106878:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869391.106884:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+8:10337:x1875765324997504:12345-0@lo:104: 00010000:00010000:0.0:1788869391.106892:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.106918:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788869391.106923:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+8:10337:x1875765324997504:12345-0@lo:104: Request processed in 40us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.106928:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869391.106975:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869391.106982:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+7:10337:x1875765324997632:12345-0@lo:104: 00010000:00010000:0.0:1788869391.106988:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107014:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788869391.107019:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+7:10337:x1875765324997632:12345-0@lo:104: Request processed in 39us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.107032:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869391.107044:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869391.107049:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:10337:x1875765324997760:12345-0@lo:104: 00010000:00010000:0.0:1788869391.107056:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107084:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788869391.107089:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:10337:x1875765324997760:12345-0@lo:104: Request processed in 40us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.107094:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869391.107106:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869391.107112:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:10337:x1875765324997888:12345-0@lo:104: 00010000:00010000:0.0:1788869391.107119:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107144:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788869391.107149:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:10337:x1875765324997888:12345-0@lo:104: Request processed in 39us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.107155:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869391.107166:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869391.107171:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:10337:x1875765324998016:12345-0@lo:104: 00010000:00010000:0.0:1788869391.107178:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107202:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788869391.107207:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:10337:x1875765324998016:12345-0@lo:104: Request processed in 36us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.107218:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869391.107229:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869391.107234:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:10337:x1875765324998144:12345-0@lo:104: 00010000:00010000:0.0:1788869391.107242:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107269:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1788869391.107273:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:10337:x1875765324998144:12345-0@lo:104: Request processed in 40us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.107278:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788869391.107298:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788869391.107304:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107311:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869391.107315:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107323:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869391.107330:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869391.107336:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869391.107368:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107375:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869391.107400:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107407:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6ce850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce857 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107421:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788869391.107424:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107430:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869391.107432:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107439:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869391.107445:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869391.107450:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869391.107463:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107469:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869391.107473:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107479:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6ce826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce82d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107488:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788869391.107496:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107502:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800030e00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869391.107505:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107512:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869391.107518:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869391.107524:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869391.107537:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107542:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869391.107556:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107563:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6ce80a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce811 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107573:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788869391.107575:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107581:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869391.107583:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107620:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869391.107627:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869391.107632:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869391.107644:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107649:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869391.107654:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107660:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6ce7e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107670:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788869391.107674:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107679:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869391.107682:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107699:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869391.107705:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869391.107715:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869391.107729:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107734:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869391.107739:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107745:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6ce7c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107756:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788869391.107759:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107764:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869391.107767:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107774:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869391.107780:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869391.107785:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869391.107796:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107801:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869391.107812:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107818:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce7b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107827:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869391.107830:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107836:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869391.107839:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107845:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869391.107851:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869391.107856:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869391.107866:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107871:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869391.107874:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107880:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6ce7a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce7af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107887:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869391.107895:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107901:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031a00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869391.107904:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107910:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869391.107915:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869391.107920:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869391.107931:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107936:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869391.107940:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107946:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2800031a00/0x4c16c38a9b6ce769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce770 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107955:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869391.107958:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107963:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8a00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869391.107965:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.107980:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869391.107986:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869391.107991:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869391.108003:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108008:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869391.108013:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108019:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6ce73f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce746 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108038:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869391.108040:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869391.108042:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869391.108051:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869391.108057:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869391.108080:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324998272:0@lo:103: 00000100:00100000:0.0:1788869391.108121:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.108142:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324998784:0@lo:103: 00000100:00100000:0.0:1788869391.108159:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.108174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324999296:0@lo:103: 00000100:00100000:0.0:1788869391.108191:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.108220:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788869391.108226:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324998400:0@lo:103: 00000100:00100000:0.0:1788869391.108243:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.108250:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324998912:0@lo:103: 00000100:00100000:0.0:1788869391.108262:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.108283:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324998528:0@lo:103: 00000100:00100000:0.0:1788869391.108303:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.108313:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324999040:0@lo:103: 00000100:00100000:0.0:1788869391.108328:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.108338:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788869391.108342:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324998656:0@lo:103: 00000100:00100000:0.0:1788869391.108358:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.108365:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324999168:0@lo:103: 00000100:00100000:0.0:1788869391.108379:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869391.108403:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324998272 00000100:00100000:0.0:1788869391.108409:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324998272 00010000:00010000:0.0:1788869391.108433:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce850 expref: 24 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.108449:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324998784 00000100:00100000:0.0:1788869391.108452:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324998784 00010000:00010000:0.0:1788869391.108461:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7c4 expref: 25 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.108471:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324999296 00000100:00100000:0.0:1788869391.108474:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324999296 00010000:00010000:0.0:1788869391.108483:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce73f expref: 26 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.108507:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324998400 00000100:00100000:0.0:1788869391.108510:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324998400 00010000:00010000:0.0:1788869391.108522:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce826 expref: 27 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.108531:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324998912 00000100:00100000:0.0:1788869391.108534:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324998912 00010000:00010000:0.0:1788869391.108545:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7b6 expref: 28 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.108553:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324998528 00000100:00100000:0.0:1788869391.108555:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324998528 00010000:00010000:0.0:1788869391.108578:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce80a expref: 29 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.108609:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324999040 00000100:00100000:0.0:1788869391.108612:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324999040 00010000:00010000:0.0:1788869391.108622:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7a8 expref: 30 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.108630:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324998656 00000100:00100000:0.0:1788869391.108632:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324998656 00010000:00010000:0.0:1788869391.108639:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7e0 expref: 31 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.108647:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324999168 00000100:00100000:0.0:1788869391.108648:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324999168 00010000:00010000:0.0:1788869391.108656:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce769 expref: 32 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.108666:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869391.108679:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+32:3650:x1875765324998272:12345-0@lo:103: 00010000:00010000:0.0:1788869391.108705:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.108710:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce850 expref: 32 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108719:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce850 expref: 32 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108735:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869391.108768:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+32:3650:x1875765324998272:12345-0@lo:103: Request processed in 89us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.108774:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869391.108810:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869391.108816:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+31:3650:x1875765324998784:12345-0@lo:103: 00010000:00010000:0.0:1788869391.108823:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.108828:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7c4 expref: 31 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108835:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7c4 expref: 31 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108845:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869391.108864:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+31:3650:x1875765324998784:12345-0@lo:103: Request processed in 49us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.108870:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869391.108881:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869391.108885:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+30:3650:x1875765324999296:12345-0@lo:103: 00010000:00010000:0.0:1788869391.108891:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.108902:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce73f expref: 30 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108909:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce73f expref: 30 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108918:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869391.108937:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+30:3650:x1875765324999296:12345-0@lo:103: Request processed in 52us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.108943:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869391.108954:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869391.108959:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+29:3650:x1875765324998400:12345-0@lo:103: 00010000:00010000:0.0:1788869391.108965:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.108969:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce826 expref: 29 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108976:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce826 expref: 29 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.108984:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869391.109004:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+29:3650:x1875765324998400:12345-0@lo:103: Request processed in 46us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.109010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869391.109021:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869391.109027:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+28:3650:x1875765324998912:12345-0@lo:103: 00010000:00010000:0.0:1788869391.109034:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.109038:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7b6 expref: 28 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.109055:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7b6 expref: 28 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.109064:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869391.109087:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+28:3650:x1875765324998912:12345-0@lo:103: Request processed in 60us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.109093:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869391.109104:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869391.109110:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+27:3648:x1875765324998528:12345-0@lo:103: 00010000:00010000:0.0:1788869391.109116:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.109120:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce80a expref: 27 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.109128:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce80a expref: 27 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.109137:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869391.109363:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce850 expref: 27 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.109378:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997120:0@lo:104: 00010000:00010000:2.0:1788869391.109389:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edbe00/0x4c16c38a9b6ce82d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce826 expref: 26 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.109397:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997248:0@lo:104: 00010000:00010000:2.0:1788869391.109416:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6ce811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce80a expref: 25 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.109426:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997376:0@lo:104: 00000100:00100000:2.0:1788869391.109434:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997504:0@lo:104: 00010000:00010000:2.0:1788869391.109442:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2800030000/0x4c16c38a9b6ce7cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7c4 expref: 24 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.109450:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997632:0@lo:104: 00010000:00010000:2.0:1788869391.109459:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce7bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7b6 expref: 23 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.109468:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997760:0@lo:104: 00000100:00100000:2.0:1788869391.109476:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324997888:0@lo:104: 00000100:00100000:2.0:1788869391.109484:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324998016:0@lo:104: 00010000:00010000:2.0:1788869391.109493:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2800030800/0x4c16c38a9b6ce746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce73f expref: 22 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869391.109502:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324998144:0@lo:104: 00000100:00100000:0.0:1788869391.110191:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3648:x1875765324998528:12345-0@lo:103: Request processed in 1076us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.110200:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869391.110224:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869391.110232:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3648:x1875765324999040:12345-0@lo:103: 00010000:00010000:0.0:1788869391.110246:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.110252:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7a8 expref: 20 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.110262:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7a8 expref: 20 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.110285:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb800/0x4c16c38a9b6ce7af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7a8 expref: 20 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.110295:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869391.110333:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:3648:x1875765324999040:12345-0@lo:103: Request processed in 103us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.110339:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869391.110353:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869391.110359:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:3648:x1875765324998656:12345-0@lo:103: 00010000:00010000:0.0:1788869391.110367:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.110372:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7e0 expref: 18 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.110379:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7e0 expref: 18 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.110390:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28014a8600/0x4c16c38a9b6ce7e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce7e0 expref: 18 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.110399:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869391.110419:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:3648:x1875765324998656:12345-0@lo:103: Request processed in 60us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.110424:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869391.110461:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869391.110467:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:3648:x1875765324999168:12345-0@lo:103: 00010000:00010000:0.0:1788869391.110474:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.110478:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce769 expref: 16 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.110492:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce769 expref: 16 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.110502:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce769 expref: 16 pid: 6518 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.110512:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869391.110535:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:3648:x1875765324999168:12345-0@lo:103: Request processed in 68us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.110542:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869391.110735:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324998656:0@lo:103: 00000100:00100000:0.0:1788869391.110749:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324999168:0@lo:103: 00000100:00100000:0.0:1788869391.110757:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324998528:0@lo:103: 00000100:00100000:0.0:1788869391.110763:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765324999040:0@lo:103: 00000100:00100000:0.0:1788869391.110796:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324998400:0@lo:103: 00000100:00100000:0.0:1788869391.110805:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324998912:0@lo:103: 00000100:00100000:0.0:1788869391.111051:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324998272:0@lo:103: 00000100:00100000:0.0:1788869391.111063:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324998784:0@lo:103: 00000100:00100000:0.0:1788869391.111070:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765324999296:0@lo:103: 00000100:00100000:2.0:1788869391.119137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869391.119283:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305021056 00000100:00100000:0.0:1788869391.119293:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305021056 00010000:00010000:0.0:1788869391.119333:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c30 expref: 10 pid: 6519 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869391.119396:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788869391.119406:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305021056:12345-192.168.204.54@tcp:103: 00010000:00010000:0.0:1788869391.119424:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869391.119431:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c30 expref: 10 pid: 6519 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.119444:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c30 expref: 10 pid: 6519 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869391.119467:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869391.119530:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305021056:12345-192.168.204.54@tcp:103: Request processed in 125us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.119539:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00010000:00010000:1.0:1788869391.120018:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6ce86c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c30 expref: 9 pid: 6519 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869391.120033:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324996864:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869391.120046:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875765324996992:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869391.120090:0:10337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869391.135302:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869391.139360:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305021184 00000100:00100000:0.0:1788869391.139380:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305021184 00010000:00010000:1.0:1788869391.141841:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c29 expref: 9 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869391.141913:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1788869391.141925:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:448e652b-ca43-4915-9c32-5166fb543df5+9:2408:x1875765305021184:12345-192.168.204.54@tcp:103: 00010000:00010000:1.0:1788869391.141947:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869391.141954:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c29 expref: 9 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.141970:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c29 expref: 9 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.141991:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28014a9600/0x4c16c38a9b6ce865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c29 expref: 9 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142014:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142023:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142042:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142051:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142058:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142065:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142082:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869391.142087:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142096:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142123:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869391.142135:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869391.142461:0:10337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.142470:0:10337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869391.142477:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869391.143657:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:448e652b-ca43-4915-9c32-5166fb543df5+8:2408:x1875765305021184:12345-192.168.204.54@tcp:103: Request processed in 1728us (8360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869391.143669:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1788869391.296262:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869391.296302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869391.296323:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869391.296343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869391.296367:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305021312 00000100:00100000:3.0:1788869391.296376:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305021312 00000100:00100000:3.0:1788869391.296428:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305021440 00000100:00100000:3.0:1788869391.296431:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305021440 00000100:00100000:3.0:1788869391.296452:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788869391.296462:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305021312:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1788869391.296535:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305021312:12345-192.168.204.54@tcp:400: Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869391.296544:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788869391.296560:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1788869391.296566:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305021440:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1788869391.296609:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305021440:12345-192.168.204.54@tcp:400: Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869391.296615:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00080000:3.0:1788869391.296636:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869391.296641:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869391.297402:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305021568 00000100:00100000:0.0:1788869391.297410:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305021568 00000100:00100000:0.0:1788869391.297458:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305021696 00000100:00100000:0.0:1788869391.297463:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305021696 00000100:00100000:0.0:1788869391.297485:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788869391.297493:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305021568:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1788869391.297543:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305021568:12345-192.168.204.54@tcp:400: Request processed in 50us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.297550:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788869391.297563:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1788869391.297569:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305021696:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1788869391.297627:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305021696:12345-192.168.204.54@tcp:400: Request processed in 58us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869391.297634:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00080000:3.0:1788869391.301907:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869391.301917:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788869391.558873:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869391.686694:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869391.686731:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324999424:0@lo:41: 00000100:00100000:1.0:1788869391.686827:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869391.688432:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324999424 00000100:00100000:3.0:1788869391.688449:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324999424 00000100:00100000:3.0:1788869391.688544:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788869391.688555:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324999424:12345-0@lo:41: 00000004:00000024:3.0:1788869391.689124:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869391.689251:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765324999424:12345-0@lo:41: Request processed in 697us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869391.689260:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869391.689400:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765324999424:0@lo:41: 00010000:00010000:0.0:1788869392.582117:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869392.711367:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324999808:0@lo:400: 00000100:00100000:1.0:1788869392.711447:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869392.711509:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325000320:0@lo:400: 00000100:00100000:1.0:1788869392.711539:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869392.711559:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325000832:0@lo:400: 00000100:00100000:1.0:1788869392.711616:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869392.711661:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788869392.711668:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324999936:0@lo:400: 00000100:00100000:1.0:1788869392.711701:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869392.711725:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325000448:0@lo:400: 00000100:00100000:1.0:1788869392.711746:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869392.711767:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325000960:0@lo:400: 00000100:00100000:1.0:1788869392.711787:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869392.711814:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324999808 00000100:00100000:1.0:1788869392.711822:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324999808 00000100:00100000:1.0:1788869392.711869:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788869392.711879:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324999808:12345-0@lo:400: 00000100:00100000:1.0:1788869392.711937:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765324999808:12345-0@lo:400: Request processed in 60us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869392.711945:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788869392.711989:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325000320 00000100:00100000:1.0:1788869392.711993:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325000320 00000100:00100000:1.0:1788869392.712023:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325000832 00000100:00100000:1.0:1788869392.712026:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325000832 00000100:00100000:1.0:1788869392.712039:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324999936 00000100:00100000:1.0:1788869392.712041:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324999936 00000100:00100000:1.0:1788869392.712052:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788869392.712058:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325000320:12345-0@lo:400: 00000100:00100000:1.0:1788869392.712090:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325000320:12345-0@lo:400: Request processed in 32us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869392.712097:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788869392.712112:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788869392.712116:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325000832:12345-0@lo:400: 00000100:00100000:1.0:1788869392.712139:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325000832:12345-0@lo:400: Request processed in 23us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869392.712154:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788869392.712168:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788869392.712172:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324999936:12345-0@lo:400: 00000100:00100000:1.0:1788869392.712196:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765324999936:12345-0@lo:400: Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869392.712201:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788869392.712218:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869392.712250:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765324999936:0@lo:400: 00000100:00100000:1.0:1788869392.712259:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765324999808:0@lo:400: 00010000:00080000:1.0:1788869392.712268:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5f800 x1875765325000320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869392.712277:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325000320:0@lo:400: 00010000:00080000:1.0:1788869392.712284:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db37800 x1875765325000832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869392.712291:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325000832:0@lo:400: 00000100:00100000:2.0:1788869392.713152:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324999680:0@lo:400: 00000100:00100000:2.0:1788869392.713208:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869392.713251:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325000192:0@lo:400: 00000100:00100000:2.0:1788869392.713272:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869392.713300:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325000704:0@lo:400: 00000100:00100000:2.0:1788869392.713320:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869392.713344:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788869392.713350:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324999552:0@lo:400: 00000100:00100000:2.0:1788869392.713376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869392.713397:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325000064:0@lo:400: 00000100:00100000:2.0:1788869392.713421:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869392.713441:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325000576:0@lo:400: 00000100:00100000:2.0:1788869392.713464:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869392.713483:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325001088:0@lo:400: 00000100:00100000:2.0:1788869392.713504:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869392.713536:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325000064 00000100:00100000:2.0:1788869392.713542:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325000064 00000100:00100000:2.0:1788869392.713583:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869392.713624:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325000064:12345-0@lo:400: 00000100:00100000:2.0:1788869392.713694:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325000064:12345-0@lo:400: Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869392.713701:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869392.713724:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325000448 00000100:00100000:2.0:1788869392.713729:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325000448 00000100:00100000:2.0:1788869392.713776:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325000960 00000100:00100000:2.0:1788869392.713779:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325000960 00000100:00100000:2.0:1788869392.713794:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325000576 00000100:00100000:2.0:1788869392.713796:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325000576 00000100:00100000:2.0:1788869392.713808:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325001088 00000100:00100000:2.0:1788869392.713811:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325001088 00000100:00100000:2.0:1788869392.713824:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869392.713830:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325000448:12345-0@lo:400: 00000100:00100000:2.0:1788869392.713868:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325000448:12345-0@lo:400: Request processed in 38us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869392.713874:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869392.713886:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869392.713891:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325000960:12345-0@lo:400: 00000100:00100000:2.0:1788869392.713915:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325000960:12345-0@lo:400: Request processed in 25us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869392.713920:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869392.713930:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869392.713935:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325000576:12345-0@lo:400: 00000100:00100000:2.0:1788869392.713959:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325000576:12345-0@lo:400: Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869392.713964:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869392.713974:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869392.713979:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325001088:12345-0@lo:400: 00000100:00100000:2.0:1788869392.714002:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325001088:12345-0@lo:400: Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869392.714007:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869392.714027:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324999680 00000100:00100000:2.0:1788869392.714030:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324999680 00000100:00100000:2.0:1788869392.714054:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325000192 00000100:00100000:2.0:1788869392.714058:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325000192 00000100:00100000:2.0:1788869392.714069:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325000704 00000100:00100000:2.0:1788869392.714071:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325000704 00000100:00100000:2.0:1788869392.714083:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869392.714088:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324999680:12345-0@lo:400: 00000100:00100000:2.0:1788869392.714119:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765324999680:12345-0@lo:400: Request processed in 30us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869392.714125:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869392.714135:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869392.714141:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325000192:12345-0@lo:400: 00000100:00100000:2.0:1788869392.714166:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325000192:12345-0@lo:400: Request processed in 25us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869392.714171:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869392.714183:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869392.714189:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325000704:12345-0@lo:400: 00000100:00100000:2.0:1788869392.714215:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325000704:12345-0@lo:400: Request processed in 27us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869392.714220:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788869392.714235:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869392.714239:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869392.714241:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869392.714278:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325000064:0@lo:400: 00010000:00080000:2.0:1788869392.714290:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db35880 x1875765325000576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869392.714299:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325000576:0@lo:400: 00010000:00080000:2.0:1788869392.714307:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcf800 x1875765325001088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869392.714322:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325001088:0@lo:400: 00000100:00100000:2.0:1788869392.714334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765324999680:0@lo:400: 00000100:00100000:2.0:1788869392.714341:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325000192:0@lo:400: 00000100:00100000:2.0:1788869392.714348:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325000704:0@lo:400: 00010000:00080000:2.0:1788869392.714391:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5c700 x1875765325000448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869392.714399:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325000448:0@lo:400: 00010000:00080000:2.0:1788869392.714409:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db37100 x1875765325000960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869392.714416:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325000960:0@lo:400: 00000100:00100000:0.0:1788869392.715308:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765324999552 00000100:00100000:0.0:1788869392.715320:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765324999552 00000100:00100000:0.0:1788869392.715383:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788869392.715391:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:3649:x1875765324999552:12345-0@lo:400: 00000100:00100000:0.0:1788869392.715457:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:3649:x1875765324999552:12345-0@lo:400: Request processed in 67us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869392.715464:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788869392.718379:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765324999552:0@lo:400: 10000000:01000000:0.0:1788869393.157846:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788869393.157854:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e27029d7800 from 48 10000000:01000000:0.0:1788869393.157859:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869393.157909:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.157921:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.157932:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869393.157958:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001216:0@lo:101: 00000100:00100000:0.0:1788869393.158032:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.159096:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fcaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.163093:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325001216 00000100:00100000:3.0:1788869393.163109:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325001216 00000100:00100000:3.0:1788869393.163190:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788869393.163201:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+15:6521:x1875765325001216:12345-0@lo:101: 00010000:00010000:3.0:1788869393.163226:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869393.163246:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe0600/0x4c16c38a9b6ce8b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce8b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.163273:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe0600/0x4c16c38a9b6ce8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8b2 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.163286:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe0600/0x4c16c38a9b6ce8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8b2 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.163294:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe0600, rc 0) 00000100:00100000:3.0:1788869393.163386:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765325001216:12345-0@lo:101: Request processed in 188us (5354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.163393:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788869393.163580:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001216:0@lo:101: 00010000:00010000:2.0:1788869393.163620:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.163631:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869393.163719:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001344:0@lo:501: 00000100:00100000:2.0:1788869393.163767:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.163809:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a41df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.163925:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325001344 00000100:00100000:3.0:1788869393.163931:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325001344 00000100:00100000:3.0:1788869393.163971:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788869393.163978:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765325001344:12345-0@lo:501: 00000100:00100000:3.0:1788869393.164107:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765325001344:12345-0@lo:501: Request processed in 129us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.164130:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788869393.164379:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001344:0@lo:501: 00000100:00100000:2.0:1788869393.164411:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001472:0@lo:503: 00000100:00100000:2.0:1788869393.164450:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.164473:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a41df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869393.164540:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325001472 00000100:00100000:0.0:1788869393.164550:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325001472 00000100:00100000:0.0:1788869393.164608:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788869393.164616:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765325001472:12345-0@lo:503: 00000100:00100000:0.0:1788869393.164716:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765325001472:12345-0@lo:503: Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869393.164860:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001472:0@lo:503: 00000100:00100000:0.0:1788869393.165037:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788869393.165429:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10355:1875765325001600:0@lo:502: 00000100:00100000:2.0:1788869393.165467:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.165497:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.165545:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325001600 00000100:00100000:1.0:1788869393.165550:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325001600 00000100:00100000:1.0:1788869393.165580:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788869393.165611:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:10355:x1875765325001600:12345-0@lo:502: 00000100:00100000:1.0:1788869393.165721:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:10355:x1875765325001600:12345-0@lo:502: Request processed in 134us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.165736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788869393.165887:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10355:1875765325001600:0@lo:502: 00000100:00100000:2.0:1788869393.165924:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10355:1875765325001728:0@lo:502: 00000100:00100000:2.0:1788869393.165954:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.165983:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.166036:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325001728 00000100:00100000:3.0:1788869393.166050:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325001728 00000100:00100000:3.0:1788869393.166082:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788869393.166090:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:10355:x1875765325001728:12345-0@lo:502: 00000100:00100000:3.0:1788869393.166164:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:10355:x1875765325001728:12345-0@lo:502: Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.166170:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788869393.166338:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10355:1875765325001728:0@lo:502: 00000040:00080000:2.0:1788869393.166356:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788869393.166708:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788869393.166796:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869393.166807:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.166818:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869393.166827:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788869393.166830:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788869393.166833:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788869393.166858:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.166866:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.166875:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869393.166888:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001856:0@lo:101: 00000100:00100000:3.0:1788869393.166934:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.166964:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.167021:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325001856 00000100:00100000:1.0:1788869393.167027:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325001856 00000100:00100000:1.0:1788869393.167078:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788869393.167085:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+16:6521:x1875765325001856:12345-0@lo:101: 00010000:00010000:1.0:1788869393.167094:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869393.167106:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6ce8c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.167128:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6ce8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8c0 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.167138:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6ce8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8c0 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.167147:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ee00, rc 0) 00000100:00100000:1.0:1788869393.167186:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765325001856:12345-0@lo:101: Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.167192:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788869393.167445:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001856:0@lo:101: 00010000:00010000:3.0:1788869393.167457:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.167465:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869393.167518:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001984:0@lo:501: 00000100:00100000:3.0:1788869393.167542:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.167564:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.167870:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325001984 00000100:00100000:1.0:1788869393.167876:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325001984 00000100:00100000:1.0:1788869393.167908:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788869393.167915:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765325001984:12345-0@lo:501: 00000100:00100000:1.0:1788869393.168047:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765325001984:12345-0@lo:501: Request processed in 124us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.168054:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788869393.168875:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325001984:0@lo:501: 00000100:00100000:3.0:1788869393.168918:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325002112:0@lo:503: 00000100:00100000:3.0:1788869393.168971:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.169007:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869393.169065:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325002112 00000100:00100000:2.0:1788869393.169070:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325002112 00000100:00100000:2.0:1788869393.169106:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788869393.169114:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765325002112:12345-0@lo:503: 00000100:00100000:2.0:1788869393.169213:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765325002112:12345-0@lo:503: Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869393.169228:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788869393.169357:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325002112:0@lo:503: 00000100:00100000:0.0:1788869393.169971:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10356:1875765325002240:0@lo:502: 00000100:00100000:0.0:1788869393.170017:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.170061:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869393.170165:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325002240 00000100:00100000:2.0:1788869393.170171:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325002240 00000100:00100000:2.0:1788869393.170208:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788869393.170216:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:10356:x1875765325002240:12345-0@lo:502: 00000100:00100000:2.0:1788869393.170320:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:10356:x1875765325002240:12345-0@lo:502: Request processed in 104us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869393.170334:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788869393.170468:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10356:1875765325002240:0@lo:502: 00000020:01000000:0.0:1788869393.170489:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869393.170498:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869393.170500:0:10356:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788869393.170505:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788869393.170524:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10356:1875765325002368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869393.170553:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.170574:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.170677:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325002368 00000100:00100000:1.0:1788869393.170682:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325002368 00000100:00100000:1.0:1788869393.170706:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788869393.170713:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:10356:x1875765325002368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869393.170791:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:10356:x1875765325002368:12345-0@lo:502:llog_process_th.0 Request processed in 78us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.170802:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788869393.170957:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10356:1875765325002368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869393.170974:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869393.170978:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869393.170979:0:10356:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788869393.170983:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788869393.171345:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788869393.171372:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788869393.171382:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.171394:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869393.171404:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788869393.171407:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e283b46c800 from 48 10000000:01000000:1.0:1788869393.171409:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869393.171435:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.171442:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.171450:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869393.171465:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325002496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869393.171508:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869393.171540:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869393.171616:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325002496 00000100:00100000:2.0:1788869393.171622:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325002496 00000100:00100000:2.0:1788869393.171663:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788869393.171671:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+17:6521:x1875765325002496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869393.171682:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869393.171694:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.171715:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8ce expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.171800:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8ce expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.171810:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb000, rc 0) 00000100:00100000:2.0:1788869393.171854:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765325002496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869393.171859:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788869393.171971:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325002496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869393.171984:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.172006:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869393.172121:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325002624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869393.172144:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869393.172169:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.172285:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325002624 00000100:00100000:3.0:1788869393.172289:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325002624 00000100:00100000:3.0:1788869393.172323:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788869393.172330:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765325002624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.172453:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765325002624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.172460:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788869393.172526:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325002624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.172552:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325002752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.172625:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.172658:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.172704:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325002752 00000100:00100000:3.0:1788869393.172708:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325002752 00000100:00100000:3.0:1788869393.173028:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788869393.173035:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765325002752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.173332:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765325002752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 297us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.173340:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788869393.173497:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325002752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.173992:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10357:1875765325002880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869393.174035:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.174139:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fca600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869393.174181:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325002880 00000100:00100000:2.0:1788869393.174186:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325002880 00000100:00100000:3.0:1788869393.174430:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788869393.174440:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:10357:x1875765325002880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.174552:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:10357:x1875765325002880:12345-0@lo:502:llog_process_th.0 Request processed in 114us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.174559:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788869393.175172:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10357:1875765325002880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869393.175304:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10357:1875765325003008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869393.175350:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.175433:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fca600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.180381:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325003008 00000100:00100000:1.0:1788869393.180398:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325003008 00000100:00100000:1.0:1788869393.180457:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788869393.180467:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:10357:x1875765325003008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869393.180685:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:10357:x1875765325003008:12345-0@lo:502:llog_process_th.0 Request processed in 219us (5333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.180693:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788869393.181185:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10357:1875765325003008:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788869393.181233:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788869393.181513:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788869393.181535:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869393.181545:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.181557:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869393.181567:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788869393.181570:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788869393.181573:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869393.181663:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.181683:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.181695:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869393.181717:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869393.181771:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869393.181808:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869393.182085:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325003136 00000100:00100000:0.0:1788869393.182093:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325003136 00000100:00100000:0.0:1788869393.182129:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788869393.182137:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+18:6521:x1875765325003136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869393.182151:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869393.182164:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5c00/0x4c16c38a9b6ce8e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce8dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.182187:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5c00/0x4c16c38a9b6ce8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8dc expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.182198:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5c00/0x4c16c38a9b6ce8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8dc expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.182206:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5c00, rc 0) 00000100:00100000:0.0:1788869393.182277:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765325003136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869393.182284:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788869393.182423:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869393.182437:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.182446:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869393.182523:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.182552:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.182583:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.182668:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325003264 00000100:00100000:3.0:1788869393.182673:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325003264 00000100:00100000:3.0:1788869393.182702:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788869393.182710:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765325003264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.182845:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765325003264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.182852:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788869393.182975:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.183000:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.183038:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.183064:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.183477:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325003392 00000100:00100000:3.0:1788869393.183483:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325003392 00000100:00100000:3.0:1788869393.183504:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788869393.183510:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765325003392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.183647:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765325003392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.183654:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788869393.183909:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.184307:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10358:1875765325003520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869393.184353:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.184388:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.184677:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325003520 00000100:00100000:3.0:1788869393.184684:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325003520 00000100:00100000:3.0:1788869393.184710:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788869393.184718:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:10358:x1875765325003520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.184835:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:10358:x1875765325003520:12345-0@lo:502:llog_process_th.0 Request processed in 117us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.184841:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788869393.185004:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10358:1875765325003520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869393.185027:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869393.185036:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869393.185051:0:10358:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788869393.185059:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788869393.185080:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10358:1875765325003648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869393.185113:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.185131:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.185254:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325003648 00000100:00100000:1.0:1788869393.185259:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325003648 00000100:00100000:1.0:1788869393.185280:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788869393.185287:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:10358:x1875765325003648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869393.185369:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:10358:x1875765325003648:12345-0@lo:502:llog_process_th.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.185376:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788869393.185568:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10358:1875765325003648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869393.185619:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869393.185624:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869393.185625:0:10358:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788869393.185635:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788869393.185908:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788869393.185932:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788869393.185943:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.185953:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869393.185963:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788869393.185966:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e282daf5000 from 48 10000000:01000000:0.0:1788869393.185969:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869393.185994:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.186002:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.186010:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869393.186023:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.186067:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.186086:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fca600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.186204:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325003776 00000100:00100000:3.0:1788869393.186210:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325003776 00000100:00100000:3.0:1788869393.186248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788869393.186255:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:6521:x1875765325003776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869393.186264:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869393.186276:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe0200/0x4c16c38a9b6ce8f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce8ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.186296:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe0200/0x4c16c38a9b6ce8f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8ea expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.186306:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe0200/0x4c16c38a9b6ce8f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8ea expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.186314:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe0200, rc 0) 00000100:00100000:3.0:1788869393.186342:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765325003776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.186348:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788869393.186528:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869393.186541:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.186562:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869393.186660:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.186687:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.186709:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fca600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.187183:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325003904 00000100:00100000:3.0:1788869393.187189:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325003904 00000100:00100000:3.0:1788869393.187231:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788869393.187238:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765325003904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.187348:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765325003904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.187366:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788869393.187486:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325003904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.187513:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325004032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.187545:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.187571:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fca600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.187652:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325004032 00000100:00100000:1.0:1788869393.187656:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325004032 00000100:00100000:1.0:1788869393.187684:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788869393.187690:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765325004032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869393.187773:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765325004032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.187779:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788869393.187907:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325004032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.199513:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10359:1875765325004160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869393.202326:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.202449:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fcaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.213400:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325004160 00000100:00100000:1.0:1788869393.213419:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325004160 00000100:00100000:1.0:1788869393.213550:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788869393.213580:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:10359:x1875765325004160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869393.215020:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:10359:x1875765325004160:12345-0@lo:502:llog_process_th.0 Request processed in 1437us (12696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.215032:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788869393.215204:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10359:1875765325004160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.215298:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10359:1875765325004288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.215351:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.218564:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869393.224554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325004288 00000100:00100000:2.0:1788869393.224571:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325004288 00000100:00100000:2.0:1788869393.224618:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325004416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869393.224716:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.225165:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325004544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869393.225196:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.225305:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325004416 00000100:00100000:2.0:1788869393.225311:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325004416 00000100:00100000:2.0:1788869393.225350:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325004544 00000100:00100000:2.0:1788869393.225353:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325004544 00000100:00100000:2.0:1788869393.225366:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869393.225374:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325004416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869393.225406:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869393.225449:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325004416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869393.225455:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869393.225470:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869393.225475:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325004544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869393.225505:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869393.225535:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325004544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869393.225541:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788869393.225575:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d7480 x1875765325004416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869393.225617:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325004416:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788869393.226933:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d6680 x1875765325004544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869393.226974:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325004544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869393.227033:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788869393.227295:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:10359:x1875765325004288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869393.227476:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:10359:x1875765325004288:12345-0@lo:502:llog_process_th.0 Request processed in 260us (12124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869393.227485:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788869393.227759:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10359:1875765325004288:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788869393.227789:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788869393.228192:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788869393.228210:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869393.228423:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.228437:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869393.228448:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788869393.228451:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788869393.228454:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788869393.228490:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.228498:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.228507:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869393.228529:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325004672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.228624:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.228665:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869393.228751:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325004672 00000100:00100000:0.0:1788869393.228758:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325004672 00000100:00100000:0.0:1788869393.228811:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788869393.228820:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765325004672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869393.228831:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869393.228844:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6ce8ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce8f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.228865:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6ce8ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8f8 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.228887:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6ce8ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8f8 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.228895:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4600, rc 0) 00000100:00100000:0.0:1788869393.228936:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325004672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869393.228942:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788869393.229394:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325004672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869393.229409:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.229419:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869393.229487:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325004800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.229525:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.229552:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869393.229926:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325004800 00000100:00100000:0.0:1788869393.229932:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325004800 00000100:00100000:0.0:1788869393.229967:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788869393.229976:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325004800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.230437:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325004800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 460us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869393.230446:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788869393.235387:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325004800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.239408:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325004928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.239519:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.239630:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869393.243858:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325004928 00000100:00100000:2.0:1788869393.243879:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325004928 00000100:00100000:3.0:1788869393.244025:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788869393.244048:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325004928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.244279:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325004928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.244288:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788869393.244459:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325004928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.245095:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10360:1875765325005056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869393.245153:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.245197:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869393.245246:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325005056 00000100:00100000:0.0:1788869393.245251:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325005056 00000100:00100000:0.0:1788869393.245286:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788869393.245295:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:10360:x1875765325005056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869393.245402:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:10360:x1875765325005056:12345-0@lo:502:llog_process_th.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869393.245410:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788869393.245833:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10360:1875765325005056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869393.245865:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869393.245875:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869393.245877:0:10360:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788869393.245884:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788869393.245908:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10360:1875765325005184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869393.245945:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.245976:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869393.246020:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325005184 00000100:00100000:0.0:1788869393.246024:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325005184 00000100:00100000:0.0:1788869393.246069:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788869393.246083:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:10360:x1875765325005184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869393.246170:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:10360:x1875765325005184:12345-0@lo:502:llog_process_th.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869393.246178:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788869393.246326:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10360:1875765325005184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869393.246342:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869393.246347:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869393.246349:0:10360:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788869393.246353:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788869393.247088:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788869393.247122:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788869393.247133:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.247146:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869393.247159:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788869393.247163:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e281757b800 from 48 10000000:01000000:0.0:1788869393.247166:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869393.247204:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.247214:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.247234:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869393.247253:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325005312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.247298:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.247325:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28079869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.247835:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325005312 00000100:00100000:1.0:1788869393.247844:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325005312 00000100:00100000:1.0:1788869393.247895:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788869393.247904:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325005312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869393.247923:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869393.247938:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce90d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce906 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.247963:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce906 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.247974:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce906 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869393.247983:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7fc00, rc 0) 00000100:00100000:1.0:1788869393.248027:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325005312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.248034:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788869393.248267:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325005312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869393.248296:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.248306:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869393.248372:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325005440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.248402:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869393.248429:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28079869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.248544:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325005440 00000100:00100000:1.0:1788869393.248549:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325005440 00000100:00100000:1.0:1788869393.248580:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788869393.248616:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325005440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869393.248760:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325005440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.248776:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788869393.248923:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325005440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.248952:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325005568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.248991:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.249018:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.249191:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325005568 00000100:00100000:1.0:1788869393.249196:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325005568 00000100:00100000:1.0:1788869393.249468:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788869393.249477:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325005568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869393.249574:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325005568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.249581:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788869393.249716:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325005568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.249963:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10361:1875765325005696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.250000:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.253581:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869393.263216:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325005696 00000100:00100000:2.0:1788869393.263305:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325005696 00000100:00100000:3.0:1788869393.267439:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788869393.267455:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:10361:x1875765325005696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.267710:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:10361:x1875765325005696:12345-0@lo:502:llog_process_th.0 Request processed in 258us (17709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.267718:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788869393.267874:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10361:1875765325005696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.267948:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10361:1875765325005824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.267994:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.268023:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325005824 00000100:00100000:3.0:1788869393.268031:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325005824 00000100:00100000:3.0:1788869393.268134:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788869393.268141:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:10361:x1875765325005824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.268208:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:10361:x1875765325005824:12345-0@lo:502:llog_process_th.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.268285:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788869393.268327:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.268339:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10361:1875765325005824:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788869393.268357:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788869393.268428:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788869393.268451:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869393.268461:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.268473:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869393.268491:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788869393.268494:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788869393.268497:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788869393.268522:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.268530:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.268539:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869393.268552:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325005952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.268579:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.268617:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.268630:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325005952 00000100:00100000:3.0:1788869393.268634:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325005952 00000100:00100000:3.0:1788869393.268664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788869393.268671:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325005952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869393.268679:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869393.268690:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe1800/0x4c16c38a9b6ce91b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce914 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.268712:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe1800/0x4c16c38a9b6ce91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce914 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.269338:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe1800/0x4c16c38a9b6ce91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce914 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.269365:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe1800, rc 0) 00000100:00100000:3.0:1788869393.269453:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325005952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 783us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.269461:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788869393.270964:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325005952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869393.270992:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.271003:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869393.271407:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325006080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.271464:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.271549:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.271658:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325006080 00000100:00100000:3.0:1788869393.271666:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325006080 00000100:00100000:3.0:1788869393.271830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788869393.271841:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325006080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.271980:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325006080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.271988:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788869393.272062:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325006080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.272093:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325006208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.272135:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.272525:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869393.272663:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325006208 00000100:00100000:1.0:1788869393.272670:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325006208 00000100:00100000:1.0:1788869393.272697:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788869393.272704:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325006208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869393.272812:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325006208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869393.272818:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788869393.272943:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325006208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869393.274550:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10362:1875765325006336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869393.274839:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869393.274914:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038dfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869393.274959:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325006336 00000100:00100000:3.0:1788869393.274966:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325006336 00000100:00100000:3.0:1788869393.275012:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788869393.275021:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:10362:x1875765325006336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869393.275885:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:10362:x1875765325006336:12345-0@lo:502:llog_process_th.0 Request processed in 861us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869393.275896:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788869393.275975:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10362:1875765325006336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869393.276006:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869393.276016:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869393.276018:0:10362:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788869393.276024:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788869393.276129:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10362:1875765325006464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869393.276325:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869393.276367:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038dfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869393.276430:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325006464 00000100:00100000:0.0:1788869393.276436:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325006464 00000100:00100000:0.0:1788869393.276514:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788869393.276524:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:10362:x1875765325006464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869393.276672:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:10362:x1875765325006464:12345-0@lo:502:llog_process_th.0 Request processed in 149us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869393.276680:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788869393.276884:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10362:1875765325006464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869393.276906:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869393.276912:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869393.276914:0:10362:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788869393.276924:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788869393.277376:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1788869393.277411:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788869393.277424:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.277436:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869393.277458:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788869393.277461:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e282a933380 from 1 10000000:01000000:3.0:1788869393.277463:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788869393.277492:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.277500:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869393.277510:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869393.277527:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325006592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869393.277576:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869393.277707:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869393.277824:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325006592 00000100:00100000:0.0:1788869393.277830:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325006592 00000100:00100000:0.0:1788869393.277870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788869393.277878:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325006592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869393.277891:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869393.277903:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb4e00/0x4c16c38a9b6ce929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce922 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.277925:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb4e00/0x4c16c38a9b6ce929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce922 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.277937:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb4e00/0x4c16c38a9b6ce929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce922 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.277953:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4e00, rc 0) 00000100:00100000:0.0:1788869393.277999:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325006592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869393.278006:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788869393.278154:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325006592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869393.278181:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce929 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.278190:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce929 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869393.278250:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325006720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869393.278278:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869393.278302:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869393.278452:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325006720 00000100:00100000:0.0:1788869393.278457:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325006720 00000100:00100000:0.0:1788869393.278475:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788869393.278481:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325006720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869393.278554:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325006720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (275us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869393.278560:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788869393.278825:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325006720:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788869393.278857:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788869393.278863:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce929 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869393.278870:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce929 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869393.606025:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869394.633055:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869394.758533:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325006848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869394.758672:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869394.759084:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325006848 00000100:00100000:0.0:1788869394.759094:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325006848 00000100:00100000:0.0:1788869394.759152:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869394.759162:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325006848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869394.759201:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869394.759272:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325006848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869394.759280:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788869394.759944:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325006848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869394.817888:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869394.817985:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305021824 00000100:00100000:2.0:1788869394.817996:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305021824 00000100:00100000:2.0:1788869394.818054:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 243 00000100:00100000:2.0:1788869394.818064:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+8:6181:x1875765305021824:12345-192.168.204.54@tcp:101: 00010000:00010000:2.0:1788869394.818083:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869394.818101:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ca0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869394.818146:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ca0 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869394.818157:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ca0 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869394.818165:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edaa00, rc 0) 00000100:00100000:2.0:1788869394.818260:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+9:6181:x1875765305021824:12345-192.168.204.54@tcp:101: Request processed in 197us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869394.818267:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 243 00000100:00100000:0.0:1788869394.851305:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869394.851887:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305021952 00000100:00100000:1.0:1788869394.851901:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305021952 00000100:00100000:1.0:1788869394.851967:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:1.0:1788869394.851977:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+9:6181:x1875765305021952:12345-192.168.204.54@tcp:501: 00000100:00100000:1.0:1788869394.852160:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+9:6181:x1875765305021952:12345-192.168.204.54@tcp:501: Request processed in 183us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869394.852168:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:1.0:1788869394.857090:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869394.864981:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305022080 00000100:00100000:2.0:1788869394.864997:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305022080 00000100:00100000:2.0:1788869394.865153:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 245 00000100:00100000:2.0:1788869394.865165:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+9:6181:x1875765305022080:12345-192.168.204.54@tcp:503: 00000100:00100000:2.0:1788869394.865358:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+9:6181:x1875765305022080:12345-192.168.204.54@tcp:503: Request processed in 194us (8279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869394.865366:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 245 00000100:00100000:2.0:1788869394.896751:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869394.896913:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305022208 00000100:00100000:3.0:1788869394.896924:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305022208 00000100:00100000:3.0:1788869394.896989:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 246 00000100:00100000:3.0:1788869394.897000:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+9:6674:x1875765305022208:12345-192.168.204.54@tcp:502: 00000100:00100000:3.0:1788869394.897186:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+9:6674:x1875765305022208:12345-192.168.204.54@tcp:502: Request processed in 181us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869394.897194:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 246 00000100:00100000:0.0:1788869394.913808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869394.913971:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305022336 00000100:00100000:2.0:1788869394.913984:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305022336 00000100:00100000:2.0:1788869394.914045:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:2.0:1788869394.914055:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+9:6674:x1875765305022336:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869394.914231:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+9:6674:x1875765305022336:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 177us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869394.914239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:0.0:1788869394.920556:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869394.920696:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305022464 00000100:00100000:1.0:1788869394.920709:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305022464 00000100:00100000:1.0:1788869394.920789:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 248 00000100:00100000:1.0:1788869394.920800:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+9:6181:x1875765305022464:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869394.920817:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869394.920836:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869394.920866:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ca7 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869394.920878:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ca7 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869394.920889:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e200, rc 0) 00000100:00100000:1.0:1788869394.920957:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:6181:x1875765305022464:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 157us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869394.920979:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 248 00000100:00100000:1.0:1788869394.924889:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869394.924990:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305022592 00000100:00100000:3.0:1788869394.925003:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305022592 00000100:00100000:3.0:1788869394.925073:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 249 00000100:00100000:3.0:1788869394.925085:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:6181:x1875765305022592:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869394.925230:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:6181:x1875765305022592:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 147us (519us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869394.925251:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 249 00010000:00010000:0.0:1788869395.654707:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869395.782030:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325006976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869395.782143:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869395.782394:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325006976 00000100:00100000:1.0:1788869395.782405:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325006976 00000100:00100000:1.0:1788869395.782489:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869395.782500:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325006976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869395.782537:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869395.782637:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325006976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869395.782645:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788869395.782931:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869395.782970:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d7480 x1875765325006976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869395.782992:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325006976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869395.783019:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869395.783025:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325007104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869395.783052:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869395.783135:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325007104 00000100:00100000:1.0:1788869395.783140:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325007104 00000100:00100000:1.0:1788869395.783191:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869395.783198:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325007104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869395.783211:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869395.783241:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325007104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869395.783247:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788869395.783532:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869395.783554:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d4000 x1875765325007104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869395.783571:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325007104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869396.412197:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869396.412241:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869396.412276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869396.412299:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869396.412420:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305022848 00000100:00100000:1.0:1788869396.412433:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305022848 00000100:00100000:1.0:1788869396.412497:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305022976 00000100:00100000:1.0:1788869396.412501:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305022976 00000100:00100000:1.0:1788869396.412525:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:1.0:1788869396.412536:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305022848:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869396.412662:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305022848:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 116us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869396.412683:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:1.0:1788869396.412729:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:1.0:1788869396.412736:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305022976:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869396.412763:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305022976:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869396.412770:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00080000:1.0:1788869396.412791:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869396.412795:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869396.413076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869396.413100:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305022720 00000100:00100000:2.0:1788869396.413105:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305022720 00000100:00100000:2.0:1788869396.413137:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 250 00000100:00100000:2.0:1788869396.413145:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:2408:x1875765305022720:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869396.413173:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:2408:x1875765305022720:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.413179:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 250 00000100:00100000:2.0:1788869396.413213:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305023104 00000100:00100000:2.0:1788869396.413217:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305023104 00000100:00100000:2.0:1788869396.413247:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305023232 00000100:00100000:2.0:1788869396.413250:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305023232 00000100:00100000:2.0:1788869396.413272:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1788869396.413278:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305023104:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869396.413303:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305023104:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.413309:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1788869396.413717:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1788869396.413729:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305023232:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869396.413763:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305023232:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 38us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.413770:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00080000:1.0:1788869396.414142:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869396.414148:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788869396.677728:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869396.809238:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869396.809265:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325007232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869396.809444:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869396.809512:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325007232 00000100:00100000:0.0:1788869396.809521:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325007232 00000100:00100000:0.0:1788869396.809581:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869396.809613:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325007232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869396.809657:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869396.810582:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325007232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 963us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869396.810859:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869396.810933:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325007232:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1788869396.828547:0:10399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7203f190 20000000:00000080:3.0:1788869396.828581:0:10399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e282f0ad400 uarg=0000000000000000 20000000:01000000:3.0:1788869396.828906:0:10399:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788869396.828913:0:10399:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788869396.828918:0:10399:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788869396.829381:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788869396.829549:0:10399:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788869396.835975:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788869396.836015:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788869396.836030:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788869396.836064:0:10399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788869396.836087:0:10399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836111:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2842042400/0x4c16c38a9b6ce5da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce5d3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836119:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce5e1 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836125:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce635 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836131:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce75b expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836175:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c68 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836183:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836226:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c68 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836242:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c68 expref: 9 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869396.836261:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007360:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869396.836363:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce75b expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836371:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce75b expref: 23 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869396.836380:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007488:0@lo:104: 00000100:00100000:1.0:1788869396.836428:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869396.836478:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce635 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836486:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce635 expref: 23 pid: 6518 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869396.836493:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007616:0@lo:104: 00000100:00100000:1.0:1788869396.836528:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869396.836568:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce5e1 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836577:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5e1 expref: 23 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869396.836611:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007744:0@lo:104: 00010000:00010000:1.0:1788869396.836844:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2842042400/0x4c16c38a9b6ce5da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce5d3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.836853:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2842042400/0x4c16c38a9b6ce5da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5d3 expref: 23 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869396.836861:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007872:0@lo:104: 00000100:00100000:1.0:1788869396.836882:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038dff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869396.836991:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788869396.837028:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869396.837042:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869396.837052:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325007488 00000100:00100000:3.0:1788869396.837060:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325007488 00000100:00100000:3.0:1788869396.837098:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325007616 00000100:00100000:3.0:1788869396.837101:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325007616 00000100:00100000:3.0:1788869396.837112:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325007744 00000100:00100000:3.0:1788869396.837114:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325007744 00000100:00100000:3.0:1788869396.837122:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325007872 00000100:00100000:3.0:1788869396.837125:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325007872 00000100:00100000:3.0:1788869396.837150:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869396.837158:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:10399:x1875765325007488:12345-0@lo:104: 00010000:00010000:3.0:1788869396.837174:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837250:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869396.837255:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:10399:x1875765325007488:12345-0@lo:104: Request processed in 99us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.837263:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869396.837283:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869396.837290:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840e02050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:10399:x1875765325007616:12345-0@lo:104: 00010000:00010000:3.0:1788869396.837297:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837328:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869396.837332:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840e02050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:10399:x1875765325007616:12345-0@lo:104: Request processed in 44us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.837337:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869396.837369:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869396.837375:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:10399:x1875765325007744:12345-0@lo:104: 00010000:00010000:3.0:1788869396.837382:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837411:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788869396.837415:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:10399:x1875765325007744:12345-0@lo:104: Request processed in 41us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.837420:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869396.837431:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869396.837436:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:10399:x1875765325007872:12345-0@lo:104: 00010000:00010000:3.0:1788869396.837442:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837473:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788869396.837478:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:10399:x1875765325007872:12345-0@lo:104: Request processed in 42us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.837483:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788869396.837501:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788869396.837506:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837513:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869396.837517:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837525:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869396.837532:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869396.837538:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869396.837579:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837609:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869396.837632:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837648:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2800031400/0x4c16c38a9b6ce75b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce762 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837675:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869396.837679:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837684:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800030400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869396.837687:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837694:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869396.837784:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869396.837791:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869396.837806:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837812:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869396.837831:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837838:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2800030400/0x4c16c38a9b6ce635 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce63c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837848:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869396.837851:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837867:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869396.837870:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837877:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869396.837883:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869396.837889:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869396.837902:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837908:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869396.837915:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837920:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6ce5e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce5e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837929:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869396.837932:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837937:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869396.837940:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837957:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869396.837963:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869396.837968:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869396.837980:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837985:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869396.837991:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.837997:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28029d7200/0x4c16c38a9b6ce5d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce5da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.838025:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869396.838027:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869396.838029:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869396.838038:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869396.838045:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869396.838061:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325008000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869396.838104:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869396.838139:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869396.838146:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325008384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869396.838169:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869396.838193:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325008128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869396.838223:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869396.838242:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869396.838247:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325008256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869396.838268:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869396.838292:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325008000 00000100:00100000:3.0:1788869396.838297:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325008000 00010000:00010000:3.0:1788869396.838322:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce75b expref: 24 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869396.838338:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325008384 00000100:00100000:3.0:1788869396.838340:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325008384 00010000:00010000:3.0:1788869396.838352:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2842042400/0x4c16c38a9b6ce5da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5d3 expref: 25 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869396.838360:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325008128 00000100:00100000:3.0:1788869396.838362:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325008128 00010000:00010000:3.0:1788869396.838371:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce635 expref: 26 pid: 6518 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869396.838379:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325008256 00000100:00100000:3.0:1788869396.838381:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325008256 00010000:00010000:3.0:1788869396.838390:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5e1 expref: 27 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869396.838401:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869396.838407:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+27:3651:x1875765325008000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869396.838418:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869396.838423:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce75b expref: 27 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.838442:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce75b expref: 27 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.838460:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869396.838490:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+27:3651:x1875765325008000:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.838497:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869396.838511:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869396.838517:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+26:3651:x1875765325008384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869396.838537:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869396.838542:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2842042400/0x4c16c38a9b6ce5da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5d3 expref: 26 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.838550:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2842042400/0x4c16c38a9b6ce5da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5d3 expref: 26 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.838575:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869396.838628:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+26:3651:x1875765325008384:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.838635:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869396.838648:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869396.838654:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+25:3648:x1875765325008128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869396.838661:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869396.838666:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce635 expref: 25 pid: 6518 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.838674:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce635 expref: 25 pid: 6518 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.838689:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869396.840899:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7e000/0x4c16c38a9b6ce762 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce75b expref: 25 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869396.840922:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007488:0@lo:104: 00010000:00010000:1.0:1788869396.840935:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6ce63c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce635 expref: 24 pid: 6518 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869396.840944:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007616:0@lo:104: 00000100:00100000:1.0:1788869396.840953:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007744:0@lo:104: 00010000:00010000:1.0:1788869396.840961:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2842042400/0x4c16c38a9b6ce5da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5d3 expref: 23 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869396.840970:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007872:0@lo:104: 00000100:00100000:0.0:1788869396.844955:0:6510:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788869396.844973:0:6510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788869396.845001:0:6511:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788869396.845016:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869396.845032:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3648:x1875765325008256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869396.845056:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869396.845067:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5e1 expref: 22 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869396.845083:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5e1 expref: 22 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869396.845106:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6ce5e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce5e1 expref: 22 pid: 6519 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869396.845144:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869396.845231:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3648:x1875765325008256:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (6960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869396.845239:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869396.845311:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325008384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869396.845324:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325008000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869396.845992:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3648:x1875765325008128:12345-0@lo:103:ldlm_bl.0 Request processed in 7334us (7763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.846001:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869396.846077:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325008256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869396.846086:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325008128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869396.848080:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869396.848291:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875765325007360:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869396.848328:0:10399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869396.848417:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305023360 00000100:00100000:3.0:1788869396.848425:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305023360 00010000:00010000:3.0:1788869396.848466:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c68 expref: 10 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869396.848505:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1788869396.848515:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:448e652b-ca43-4915-9c32-5166fb543df5+10:2409:x1875765305023360:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869396.848533:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869396.848539:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c68 expref: 10 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848565:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c68 expref: 10 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848629:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28014a8000/0x4c16c38a9b6ce87a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c68 expref: 10 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848791:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848800:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848829:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848836:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848843:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848850:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848856:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869396.848860:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848868:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848883:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.848892:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869396.848953:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:448e652b-ca43-4915-9c32-5166fb543df5+9:2409:x1875765305023360:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 439us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.848960:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00010000:00010000:1.0:1788869396.849973:0:10399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.849987:0:10399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869396.849993:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6ce93e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869397.707467:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869397.838675:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325008640:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.838750:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.838829:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325009152:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.838851:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.838881:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325009664:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.838902:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.838936:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869397.838942:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325008768:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.838967:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.838985:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325009280:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839004:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.839019:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325009792:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839038:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.839071:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325008640 00000100:00100000:2.0:1788869397.839081:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325008640 00000100:00100000:2.0:1788869397.839120:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325009152 00000100:00100000:2.0:1788869397.839123:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325009152 00000100:00100000:2.0:1788869397.839146:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325009664 00000100:00100000:2.0:1788869397.839148:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325009664 00000100:00100000:2.0:1788869397.839159:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325009280 00000100:00100000:2.0:1788869397.839161:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325009280 00000100:00100000:2.0:1788869397.839171:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325009792 00000100:00100000:2.0:1788869397.839173:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325009792 00000100:00100000:2.0:1788869397.839190:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869397.839200:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325008640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839255:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325008640:12345-0@lo:400:kworker.0 Request processed in 56us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.839263:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869397.839280:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788869397.839286:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325009152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839312:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325009152:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.839328:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788869397.839340:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869397.839346:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325009664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839372:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325009664:12345-0@lo:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.839377:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869397.839388:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869397.839393:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325009280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839418:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325009280:12345-0@lo:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.839425:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869397.839435:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788869397.839440:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325009792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839463:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325009792:12345-0@lo:400:kworker.0 Request processed in 23us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.839469:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788869397.839493:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325008768 00000100:00100000:2.0:1788869397.839497:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325008768 00000100:00100000:2.0:1788869397.839523:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869397.839541:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325008768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839574:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325008768:12345-0@lo:400:kworker.0 Request processed in 46us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.839580:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788869397.839624:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869397.839629:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869397.839669:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325008768:0@lo:400:kworker.0 00010000:00080000:2.0:1788869397.839683:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283b473480 x1875765325009280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869397.839693:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325009280:0@lo:400:kworker.0 00010000:00080000:2.0:1788869397.839701:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703911880 x1875765325009792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869397.839708:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325009792:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839717:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325008640:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839726:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325009152:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.839733:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325009664:0@lo:400:kworker.0 00000100:00100000:0.0:1788869397.840989:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325008512:0@lo:400:kworker.0 00000100:00100000:0.0:1788869397.841056:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869397.841113:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325009024:0@lo:400:kworker.0 00000100:00100000:0.0:1788869397.841138:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869397.841156:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325009536:0@lo:400:kworker.0 00000100:00100000:3.0:1788869397.841704:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325008512 00000100:00100000:3.0:1788869397.841712:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325008512 00000100:00100000:3.0:1788869397.841766:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788869397.841788:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3651:x1875765325008512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869397.841957:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3651:x1875765325008512:12345-0@lo:400:kworker.0 Request processed in 172us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869397.841964:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788869397.842029:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869397.842099:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325010048:0@lo:400:kworker.0 00000100:00100000:0.0:1788869397.842126:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.842655:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325008896:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.842692:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.842713:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325009408:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.842743:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869397.842809:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325008512:0@lo:400:kworker.0 00000100:00100000:0.0:1788869397.842861:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325009024 00000100:00100000:0.0:1788869397.842867:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325009024 00000100:00100000:0.0:1788869397.842900:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869397.842909:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325009024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869397.842956:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325009024:12345-0@lo:400:kworker.0 Request processed in 49us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869397.842963:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788869397.843022:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325009536 00000100:00100000:3.0:1788869397.843027:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325009536 00000100:00100000:1.0:1788869397.843338:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325009024:0@lo:400:kworker.0 00000100:00100000:3.0:1788869397.843642:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325008896 00000100:00100000:3.0:1788869397.843648:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325008896 00000100:00100000:3.0:1788869397.843684:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788869397.843704:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325008896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869397.843755:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325008896:12345-0@lo:400:kworker.0 Request processed in 53us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869397.843762:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788869397.844868:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325010048 00000100:00100000:0.0:1788869397.844879:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325010048 00000100:00100000:0.0:1788869397.844937:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325009408 00000100:00100000:0.0:1788869397.844941:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325009408 00000100:00100000:0.0:1788869397.844960:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869397.844968:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325010048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869397.845037:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325010048:12345-0@lo:400:kworker.0 Request processed in 71us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869397.845044:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869397.845056:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788869397.845063:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325009408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869397.845088:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325009408:12345-0@lo:400:kworker.0 Request processed in 27us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869397.845094:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788869397.845111:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869397.845121:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788869397.845153:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703911500 x1875765325010048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869397.845168:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325010048:0@lo:400:kworker.0 00010000:00080000:2.0:1788869397.845388:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703912300 x1875765325009408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869397.845398:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325009408:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.845408:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325009920:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.845439:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.845474:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325008896:0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.845516:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325009920 00000100:00100000:2.0:1788869397.845682:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325009920 00000100:00100000:2.0:1788869397.845702:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788869397.845708:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325009536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.845738:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325009536:12345-0@lo:400:kworker.0 Request processed in 31us (3714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.845744:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788869397.846004:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869397.846011:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325009920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869397.846042:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325009920:12345-0@lo:400:kworker.0 Request processed in 32us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.846048:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788869397.846084:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703910700 x1875765325009920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869397.846094:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325009920:0@lo:400:kworker.0 00010000:00080000:0.0:1788869397.846164:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703912a00 x1875765325009536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869397.846173:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325009536:0@lo:400:kworker.0 00000100:00080000:1.0:1788869397.846449:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869397.846455:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869397.882218:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869397.882738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305023488 00000100:00100000:2.0:1788869397.882753:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305023488 00000100:00100000:2.0:1788869397.882827:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00100000:2.0:1788869397.882839:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+9:6181:x1875765305023488:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869397.882858:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869397.882879:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9cae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869397.882908:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cae expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869397.882921:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cae expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869397.882946:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb400, rc 0) 00000100:00100000:2.0:1788869397.883017:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:6181:x1875765305023488:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 179us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.883024:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00100000:3.0:1788869397.891773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869397.891987:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305023616 00000100:00100000:2.0:1788869397.891998:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305023616 00000100:00100000:2.0:1788869397.892057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 253 00000100:00100000:2.0:1788869397.892069:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:6181:x1875765305023616:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869397.892313:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:6181:x1875765305023616:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 246us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.892321:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 253 00000100:00100000:1.0:1788869397.899687:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869397.899847:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305023744 00000100:00100000:3.0:1788869397.899858:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305023744 00000100:00100000:3.0:1788869397.899917:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:3.0:1788869397.899926:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:6181:x1875765305023744:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869397.900092:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:6181:x1875765305023744:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 166us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869397.900101:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:1.0:1788869397.914007:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869397.915830:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305023872 00000100:00100000:3.0:1788869397.915847:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305023872 00000100:00100000:3.0:1788869397.915919:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00100000:3.0:1788869397.915929:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:6732:x1875765305023872:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869397.916112:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:6732:x1875765305023872:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 183us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869397.916130:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00100000:1.0:1788869397.926279:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869397.926658:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305024000 00000100:00100000:3.0:1788869397.926670:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305024000 00000100:00100000:3.0:1788869397.926738:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 256 00000100:00100000:3.0:1788869397.926747:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:6732:x1875765305024000:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869397.926898:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:6732:x1875765305024000:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 150us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869397.926906:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 256 10000000:01000000:2.0:1788869398.349882:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869398.349890:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e27029d7800 from 4 10000000:01000000:2.0:1788869398.349894:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869398.349926:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869398.349938:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869398.349950:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869398.349975:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325010304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869398.350052:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869398.350105:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703952e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869398.350150:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325010176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869398.350181:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869398.350248:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325010304 00000100:00100000:2.0:1788869398.350257:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325010304 00000100:00100000:2.0:1788869398.350305:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788869398.350314:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765325010304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869398.350330:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869398.350344:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce94c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869398.350370:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce94c expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869398.350545:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce94c expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869398.350558:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb200, rc 0) 00000100:00100000:2.0:1788869398.350764:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325010304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 450us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869398.350772:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788869398.350812:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325010176 00000100:00100000:2.0:1788869398.350816:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325010176 00000100:00100000:1.0:1788869398.350822:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325010304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869398.350845:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869398.350852:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788869398.350863:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325010176:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788869398.350863:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1788869398.350891:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869398.350925:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325010176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869398.350932:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869398.350943:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325010560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869398.350985:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869398.351008:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869398.351045:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325010432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869398.351077:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.351093:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325010560 00010000:00080000:2.0:1788869398.351126:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703910700 x1875765325010176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869398.351142:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325010176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869398.351180:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325010432 00000100:00100000:1.0:1788869398.351185:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325010432 00000100:00100000:1.0:1788869398.351224:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869398.351233:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325010432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869398.351245:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869398.351287:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325010432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869398.351295:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788869398.351299:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcfb80 x1875765325010432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869398.351311:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325010432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869398.351350:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325010560 00000100:00100000:3.0:1788869398.351422:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788869398.351430:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325010560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.351712:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325010560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.351720:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788869398.356340:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325010560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.356412:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325010688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.356501:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.356557:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.356580:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325010688 00000100:00100000:3.0:1788869398.356726:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325010688 00000100:00100000:3.0:1788869398.356779:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788869398.356789:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325010688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.356918:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325010688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.356932:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788869398.356980:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325010688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.362866:0:10467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10467:1875765325010816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.362963:0:10467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.363002:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325010816 00000100:00100000:3.0:1788869398.363011:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325010816 00000100:00100000:3.0:1788869398.363056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788869398.363066:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:10467:x1875765325010816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.365314:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:10467:x1875765325010816:12345-0@lo:502:llog_process_th.0 Request processed in 2240us (2343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.365329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788869398.365427:0:10467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.366243:0:10467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10467:1875765325010816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869398.366312:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869398.366323:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869398.366326:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788869398.366333:0:10467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e27029d7800 00000020:00000080:3.0:1788869398.366336:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788869398.368541:0:10467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10467:1875765325010944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.368728:0:10467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.368766:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325010944 00000100:00100000:3.0:1788869398.368774:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325010944 00000100:00100000:3.0:1788869398.368823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788869398.368832:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:10467:x1875765325010944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.368949:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:10467:x1875765325010944:12345-0@lo:502:llog_process_th.0 Request processed in 117us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.368962:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788869398.369020:0:10467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.369044:0:10467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10467:1875765325010944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869398.370714:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869398.370728:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869398.370731:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788869398.370738:0:10467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788869398.370812:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788869398.370840:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869398.370856:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.370870:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869398.370880:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869398.370883:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e283b46c800 from 4 10000000:01000000:3.0:1788869398.370887:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869398.370924:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.370933:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.370943:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869398.370965:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.371021:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.371064:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.372041:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325011072 00000100:00100000:3.0:1788869398.372051:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325011072 00000100:00100000:3.0:1788869398.372234:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788869398.372245:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325011072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869398.372261:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869398.372276:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce95a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.372301:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce95a expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.372313:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce95a expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.372322:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe1400, rc 0) 00000100:00100000:3.0:1788869398.372377:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325011072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.372384:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788869398.372440:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869398.373260:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.373274:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869398.373350:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.373399:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.374241:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.374509:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325011200 00000100:00100000:3.0:1788869398.374526:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325011200 00000100:00100000:3.0:1788869398.374577:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788869398.374601:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325011200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.376416:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325011200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1827us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.376428:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788869398.376498:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.376568:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.376637:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.376670:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.376689:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325011328 00000100:00100000:3.0:1788869398.376695:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325011328 00000100:00100000:3.0:1788869398.376740:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788869398.376748:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325011328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.376821:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325011328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.376827:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788869398.376861:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.378884:0:10470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10470:1875765325011456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.378964:0:10470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.379005:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325011456 00000100:00100000:3.0:1788869398.379012:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325011456 00000100:00100000:3.0:1788869398.379052:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788869398.379062:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:10470:x1875765325011456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.379303:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:10470:x1875765325011456:12345-0@lo:502:llog_process_th.0 Request processed in 241us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.379312:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788869398.379372:0:10470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.379398:0:10470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10470:1875765325011456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869398.379711:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869398.379724:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869398.379727:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788869398.379737:0:10470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e283b46c800 00000020:00000080:3.0:1788869398.379741:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788869398.379855:0:10470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10470:1875765325011584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.379901:0:10470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.379926:0:10470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869398.380155:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325011584 00000100:00100000:2.0:1788869398.380162:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325011584 00000100:00100000:2.0:1788869398.380195:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788869398.380204:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:10470:x1875765325011584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869398.380303:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:10470:x1875765325011584:12345-0@lo:502:llog_process_th.0 Request processed in 100us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869398.380311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788869398.380809:0:10470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10470:1875765325011584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869398.380837:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869398.380844:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869398.380846:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788869398.380850:0:10470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788869398.380920:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788869398.380941:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869398.380955:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.380968:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869398.380980:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869398.380983:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282daf5000 from 4 10000000:01000000:3.0:1788869398.380992:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869398.381019:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.381027:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.381035:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869398.381051:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.381632:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.381669:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.381687:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325011712 00000100:00100000:3.0:1788869398.381692:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325011712 00000100:00100000:3.0:1788869398.381730:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788869398.381738:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325011712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869398.381749:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869398.381764:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce968 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.381790:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce968 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.381801:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce968 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.381809:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe1000, rc 0) 00000100:00100000:3.0:1788869398.381844:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325011712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.381863:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788869398.381984:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869398.382001:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.382009:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869398.382061:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.384241:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869398.384283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325011840 00000100:00100000:2.0:1788869398.384296:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325011840 00000100:00100000:3.0:1788869398.384309:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869398.384354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788869398.384364:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325011840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869398.384541:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325011840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869398.384549:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788869398.384747:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.384818:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.384869:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.384893:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.384908:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325011968 00000100:00100000:3.0:1788869398.384912:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325011968 00000100:00100000:3.0:1788869398.384944:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788869398.384952:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325011968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.385035:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325011968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.385042:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788869398.386544:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325011968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869398.388418:0:10472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10472:1875765325012096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869398.388525:0:10472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869398.388574:0:10472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.388814:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325012096 00000100:00100000:3.0:1788869398.388822:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325012096 00000100:00100000:3.0:1788869398.388873:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788869398.388891:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:10472:x1875765325012096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.389036:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:10472:x1875765325012096:12345-0@lo:502:llog_process_th.0 Request processed in 147us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.389043:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788869398.389204:0:10472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10472:1875765325012096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869398.389233:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869398.389243:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869398.389246:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788869398.389256:0:10472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e282daf5000 00000020:00000080:2.0:1788869398.389259:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788869398.390947:0:10472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10472:1875765325012224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869398.391014:0:10472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869398.394086:0:10472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.399318:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325012224 00000100:00100000:3.0:1788869398.399337:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325012224 00000100:00100000:3.0:1788869398.399446:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788869398.399459:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:10472:x1875765325012224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.399708:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:10472:x1875765325012224:12345-0@lo:502:llog_process_th.0 Request processed in 251us (8693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.399716:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788869398.404969:0:10472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10472:1875765325012224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869398.405013:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869398.405026:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869398.405029:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788869398.405036:0:10472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788869398.407252:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788869398.407299:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869398.407311:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869398.407326:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869398.407337:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869398.407340:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e281757b800 from 4 10000000:01000000:1.0:1788869398.407343:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869398.407386:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869398.407394:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869398.407404:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869398.407444:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325012352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869398.407512:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869398.407567:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038dff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.407723:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325012352 00000100:00100000:3.0:1788869398.407732:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325012352 00000100:00100000:3.0:1788869398.407779:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788869398.407789:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325012352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869398.407805:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869398.407818:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce976 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.407842:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce976 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.407854:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce976 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.407862:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe0800, rc 0) 00000100:00100000:3.0:1788869398.407904:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325012352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.407919:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788869398.407978:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325012352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869398.407992:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.408002:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869398.408053:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325012480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.409204:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.409253:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.409274:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325012480 00000100:00100000:3.0:1788869398.409281:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325012480 00000100:00100000:3.0:1788869398.409314:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788869398.409323:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325012480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.409453:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325012480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.409461:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788869398.409498:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325012480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.409561:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325012608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.410738:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.410775:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869398.411421:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325012608 00000100:00100000:1.0:1788869398.411431:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325012608 00000100:00100000:1.0:1788869398.411485:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788869398.411495:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325012608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869398.411744:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325012608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869398.411751:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788869398.411876:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325012608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869398.425361:0:10473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10473:1875765325012736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.425458:0:10473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.425514:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325012736 00000100:00100000:3.0:1788869398.425532:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325012736 00000100:00100000:3.0:1788869398.426294:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788869398.426315:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:10473:x1875765325012736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.431791:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:10473:x1875765325012736:12345-0@lo:502:llog_process_th.0 Request processed in 5472us (6321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.434426:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788869398.434507:0:10473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869398.434547:0:10473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10473:1875765325012736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869398.434583:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869398.436267:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869398.436270:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788869398.436291:0:10473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e281757b800 00000020:00000080:3.0:1788869398.436294:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788869398.436406:0:10473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10473:1875765325012864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.436491:0:10473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869398.436554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325012864 00000100:00100000:3.0:1788869398.436562:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325012864 00000100:00100000:3.0:1788869398.436802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788869398.436814:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:10473:x1875765325012864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869398.436938:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:10473:x1875765325012864:12345-0@lo:502:llog_process_th.0 Request processed in 125us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869398.436946:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788869398.442029:0:10473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869398.442094:0:10473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:10473:1875765325012864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869398.442244:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869398.442253:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869398.442255:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788869398.442261:0:10473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788869398.442494:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788869398.442531:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869398.442544:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869398.442557:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869398.725889:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869399.751887:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869399.879122:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869399.879148:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325012992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869399.879226:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869399.885815:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325012992 00000100:00100000:2.0:1788869399.885832:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325012992 00000100:00100000:2.0:1788869399.885901:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869399.885913:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325012992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869399.885956:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869399.886082:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325012992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (6855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869399.886090:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788869399.886278:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325012992:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788869400.774311:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869400.901756:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869400.901781:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325013120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869400.901851:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869400.901912:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325013120 00000100:00100000:1.0:1788869400.901921:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325013120 00000100:00100000:1.0:1788869400.901991:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869400.902001:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325013120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869400.902030:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869400.902077:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325013120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869400.902084:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788869400.902173:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869400.902206:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111c700 x1875765325013120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869400.902225:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325013120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869400.902558:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325013248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869400.902606:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869400.902676:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325013248 00000100:00100000:1.0:1788869400.902681:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325013248 00000100:00100000:1.0:1788869400.902726:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869400.902747:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325013248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869400.902760:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788869400.908881:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869400.911520:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325013248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8764us (8903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869400.911537:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788869400.911957:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f046a00 x1875765325013248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869400.912008:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325013248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869401.533927:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869401.533973:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869401.534123:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305024256 00000100:00100000:1.0:1788869401.534135:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305024256 00000100:00100000:1.0:1788869401.534224:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1788869401.534234:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305024256:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869401.534310:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305024256:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 78us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869401.534318:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00080000:0.0:1788869401.534739:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869401.541087:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305024128 00000100:00100000:3.0:1788869401.541106:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305024128 00000100:00100000:3.0:1788869401.541170:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:3.0:1788869401.541180:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:2408:x1875765305024128:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869401.541180:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869401.541214:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869401.541243:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869401.541250:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:2408:x1875765305024128:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 71us (7335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869401.541257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:3.0:1788869401.541301:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305024384 00000100:00100000:3.0:1788869401.541305:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305024384 00000100:00100000:3.0:1788869401.541341:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1788869401.541349:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305024384:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869401.541381:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305024384:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869401.541387:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00080000:0.0:1788869401.541669:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869401.541699:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305024512 00000100:00100000:0.0:1788869401.541705:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305024512 00000100:00100000:0.0:1788869401.541742:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305024640 00000100:00100000:0.0:1788869401.541744:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305024640 00000100:00100000:0.0:1788869401.541765:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1788869401.541771:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305024512:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869401.541802:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305024512:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869401.541809:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1788869401.541821:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1788869401.541838:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305024640:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869401.541871:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305024640:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 44us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869401.541877:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00080000:0.0:1788869401.541892:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869401.541895:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869401.798866:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869401.930692:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325013376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869401.930765:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869401.931097:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325013376 00000100:00100000:2.0:1788869401.931106:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325013376 00000100:00100000:2.0:1788869401.931156:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869401.931165:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325013376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869401.931200:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869401.931250:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325013376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869401.931257:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869401.931303:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325013376:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869402.823023:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869402.951662:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325013504:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.951756:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869402.951828:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325014016:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.951856:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869402.951876:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325014528:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.951898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869402.951915:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325015040:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.951935:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869402.951956:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788869402.951962:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325013632:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.951995:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869402.952019:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325014144:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952041:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869402.952056:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325014656:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952075:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869402.952111:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325013504 00000100:00100000:1.0:1788869402.952119:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325013504 00000100:00100000:1.0:1788869402.952168:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788869402.952178:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325013504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952233:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325013504:12345-0@lo:400:kworker.0 Request processed in 56us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869402.952240:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788869402.952289:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325014016 00000100:00100000:1.0:1788869402.952294:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325014016 00000100:00100000:1.0:1788869402.952319:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788869402.952325:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325014016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952358:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325014016:12345-0@lo:400:kworker.0 Request processed in 34us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869402.952365:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788869402.952385:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325014528 00000100:00100000:1.0:1788869402.952389:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325014528 00000100:00100000:1.0:1788869402.952434:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325015040 00000100:00100000:1.0:1788869402.952437:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325015040 00000100:00100000:1.0:1788869402.952459:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869402.952465:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325014528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952494:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325014528:12345-0@lo:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869402.952508:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869402.952525:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869402.952530:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325015040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952558:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325015040:12345-0@lo:400:kworker.0 Request processed in 28us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869402.952563:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869402.952582:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325013632 00000100:00100000:1.0:1788869402.952608:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325013632 00000100:00100000:1.0:1788869402.952629:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325014144 00000100:00100000:1.0:1788869402.952632:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325014144 00000100:00100000:1.0:1788869402.952643:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325014656 00000100:00100000:1.0:1788869402.952646:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325014656 00000100:00100000:1.0:1788869402.952659:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869402.952665:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325013632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952694:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325013632:12345-0@lo:400:kworker.0 Request processed in 30us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869402.952700:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869402.952714:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788869402.952719:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325014144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952746:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325014144:12345-0@lo:400:kworker.0 Request processed in 26us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869402.952751:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788869402.952763:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788869402.952768:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325014656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952792:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325014656:12345-0@lo:400:kworker.0 Request processed in 24us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869402.952807:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788869402.952838:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869402.952843:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869402.952846:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869402.952882:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325013632:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952892:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325014144:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952900:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325014656:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952908:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325013504:0@lo:400:kworker.0 00000100:00100000:1.0:1788869402.952916:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325014016:0@lo:400:kworker.0 00010000:00080000:1.0:1788869402.952928:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcd880 x1875765325014528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869402.952939:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325014528:0@lo:400:kworker.0 00010000:00080000:1.0:1788869402.952949:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db35f80 x1875765325015040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869402.952957:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325015040:0@lo:400:kworker.0 00000100:00100000:2.0:1788869402.954182:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325013760:0@lo:400:kworker.0 00000100:00100000:2.0:1788869402.954253:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869402.954288:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325014272:0@lo:400:kworker.0 00000100:00100000:2.0:1788869402.954312:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869402.954331:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325014784:0@lo:400:kworker.0 00000100:00100000:2.0:1788869402.954351:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869402.954372:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869402.954378:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325013888:0@lo:400:kworker.0 00000100:00100000:2.0:1788869402.954397:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869402.954438:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325014400:0@lo:400:kworker.0 00000100:00100000:2.0:1788869402.954462:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869402.954480:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325014912:0@lo:400:kworker.0 00000100:00100000:2.0:1788869402.954500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869402.956149:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325014400 00000100:00100000:2.0:1788869402.956161:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325014400 00000100:00100000:2.0:1788869402.956960:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325014912 00000100:00100000:2.0:1788869402.956967:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325014912 00000100:00100000:3.0:1788869402.962950:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325013760 00000100:00100000:3.0:1788869402.962971:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325013760 00000100:00100000:3.0:1788869402.963056:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788869402.963068:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325013760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869402.963188:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325013760:12345-0@lo:400:kworker.0 Request processed in 123us (8934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869402.963196:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788869402.963228:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325014272 00000100:00100000:3.0:1788869402.963233:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325014272 00000100:00080000:0.0:1788869402.967048:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869402.967571:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869402.967578:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869402.976896:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325014784 00000100:00100000:3.0:1788869402.976916:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325014784 00000100:00100000:3.0:1788869402.976986:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325013888 00000100:00100000:3.0:1788869402.977004:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325013888 00000100:00100000:3.0:1788869402.977027:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788869402.977038:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325014784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869402.977143:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325014784:12345-0@lo:400:kworker.0 Request processed in 107us (22792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869402.977151:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788869402.977168:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788869402.977174:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325013888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869402.977201:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325013888:12345-0@lo:400:kworker.0 Request processed in 28us (22803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869402.977207:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788869402.977257:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788869402.977265:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325014272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869402.977294:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325014272:12345-0@lo:400:kworker.0 Request processed in 30us (22981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869402.977299:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788869402.977343:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869402.977351:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325014400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869402.977380:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325014400:12345-0@lo:400:kworker.0 Request processed in 31us (22918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869402.977386:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869402.977458:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325013888:0@lo:400:kworker.0 00010000:00080000:3.0:1788869402.977474:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcc700 x1875765325014400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869402.977511:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325014400:0@lo:400:kworker.0 00000100:00100000:3.0:1788869402.977529:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325013760:0@lo:400:kworker.0 00010000:00080000:3.0:1788869402.977539:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcd500 x1875765325014272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869402.977548:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325014272:0@lo:400:kworker.0 00010000:00080000:3.0:1788869402.977558:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db36680 x1875765325014784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869402.977566:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325014784:0@lo:400:kworker.0 00000100:00080000:0.0:1788869402.979302:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869402.985469:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869402.985485:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325014912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869402.986197:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325014912:12345-0@lo:400:kworker.0 Request processed in 712us (31691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869402.986207:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788869402.986256:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db34000 x1875765325014912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869402.986274:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325014912:0@lo:400:kworker.0 00000100:00100000:1.0:1788869403.462622:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325015168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869403.462728:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869403.462847:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325015168 00000100:00100000:1.0:1788869403.462856:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325015168 00000100:00100000:1.0:1788869403.462911:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869403.462920:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325015168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869403.462973:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869403.463039:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325015168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869403.463047:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788869403.463112:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703911500 x1875765325015168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869403.463132:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325015168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869403.463435:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325015296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869403.463476:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869403.465089:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325015296 00000100:00100000:1.0:1788869403.465105:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325015296 00000100:00100000:1.0:1788869403.465164:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869403.465173:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325015296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869403.465196:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869403.465269:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325015296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869403.465275:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788869403.467056:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5c700 x1875765325015296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869403.467083:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325015296:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788869403.846781:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869404.533645:0:10701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788869404.869825:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869404.999385:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325015424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869404.999466:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869405.000783:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325015424 00000100:00100000:1.0:1788869405.000798:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325015424 00000100:00100000:1.0:1788869405.000877:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788869405.000887:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325015424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869405.000929:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869405.001037:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325015424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869405.001044:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869405.001261:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325015424:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869405.894456:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869406.022012:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325015552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869406.022089:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869406.022181:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325015552 00000100:00100000:0.0:1788869406.022192:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325015552 00000100:00100000:0.0:1788869406.022262:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869406.022273:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325015552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869406.022307:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869406.022366:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325015552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869406.022373:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788869406.022396:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869406.022431:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111dc00 x1875765325015552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869406.022452:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325015552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869406.027907:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325015680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869406.028002:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869406.028143:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325015680 00000100:00100000:2.0:1788869406.028167:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325015680 00000100:00100000:2.0:1788869406.028234:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869406.028244:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325015680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869406.028276:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869406.028327:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325015680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869406.028335:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788869406.028849:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869406.028886:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e28179e5f80 x1875765325015680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869406.028908:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325015680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869406.666887:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869406.666956:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869406.666996:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869406.667037:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305025024 00000100:00100000:1.0:1788869406.667047:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305025024 00000100:00100000:1.0:1788869406.668214:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305024896 00000100:00100000:1.0:1788869406.668224:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305024896 00000100:00100000:1.0:1788869406.668261:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:1.0:1788869406.668271:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305025024:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869406.668371:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305025024:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 102us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869406.668378:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:1.0:1788869406.668414:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:1.0:1788869406.668421:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305024896:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869406.668447:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305024896:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869406.668453:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00080000:1.0:1788869406.668480:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869406.668484:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869406.668525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869406.668607:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869406.668668:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305025152 00000100:00100000:1.0:1788869406.668673:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305025152 00000100:00100000:1.0:1788869406.668703:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305025280 00000100:00100000:1.0:1788869406.668706:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305025280 00000100:00100000:1.0:1788869406.668726:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:1.0:1788869406.668733:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2406:x1875765305025152:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1788869406.668760:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce88f 00000100:00080000:1.0:1788869406.668783:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8e283b46e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869406.668825:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788869406.668948:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+2:2406:x1875765305025152:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 215us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869406.668956:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:1.0:1788869406.668972:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788869406.668979:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2406:x1875765305025280:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1788869406.668992:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce896 00000100:00080000:1.0:1788869406.668998:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8e2702745800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869406.669020:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788869406.669584:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305024768 00000100:00100000:0.0:1788869406.669631:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305024768 00000100:00100000:0.0:1788869406.669672:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 279 00000100:00100000:0.0:1788869406.669679:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305024768:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869406.669714:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305024768:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869406.669731:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 279 00000100:00080000:0.0:1788869406.669827:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869406.669831:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869406.670886:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869406.670894:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869406.671369:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+2:2406:x1875765305025280:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 2384us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869406.671382:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:1.0:1788869406.918823:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869407.046459:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869407.046490:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325015808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869407.046578:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869407.046696:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325015808 00000100:00100000:0.0:1788869407.046707:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325015808 00000100:00100000:0.0:1788869407.046769:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788869407.046780:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325015808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869407.046820:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869407.046872:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325015808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869407.046880:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788869407.046929:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325015808:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869407.943283:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869408.071326:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325015936:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.071405:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325016064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869408.071433:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869408.071446:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869408.071513:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325016320:0@lo:400:kworker.0 00000100:00100000:2.0:1788869408.071547:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869408.072034:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325016448:0@lo:400:kworker.0 00000100:00100000:3.0:1788869408.072066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869408.072090:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325016960:0@lo:400:kworker.0 00000100:00100000:3.0:1788869408.072117:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869408.072137:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325017472:0@lo:400:kworker.0 00000100:00100000:3.0:1788869408.072158:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869408.072198:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325016448 00000100:00100000:3.0:1788869408.072207:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325016448 00000100:00100000:3.0:1788869408.072277:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788869408.072290:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325016448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869408.072359:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325016448:12345-0@lo:400:kworker.0 Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869408.072382:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788869408.072409:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325016960 00000100:00100000:3.0:1788869408.072413:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325016960 00000100:00100000:3.0:1788869408.072639:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325017472 00000100:00100000:3.0:1788869408.072643:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325017472 00000100:00100000:3.0:1788869408.072666:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869408.072673:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325016960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869408.072706:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325016960:12345-0@lo:400:kworker.0 Request processed in 34us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869408.072712:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869408.072723:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788869408.072730:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325017472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869408.072755:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325017472:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869408.072761:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788869408.072782:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869408.072786:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869408.072815:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325016448:0@lo:400:kworker.0 00010000:00080000:3.0:1788869408.072827:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcf800 x1875765325016960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869408.072838:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325016960:0@lo:400:kworker.0 00010000:00080000:3.0:1788869408.072848:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8f800 x1875765325017472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869408.072856:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325017472:0@lo:400:kworker.0 00000100:00100000:2.0:1788869408.073215:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325016832:0@lo:400:kworker.0 00000100:00100000:2.0:1788869408.073251:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869408.073302:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325017344:0@lo:400:kworker.0 00000100:00100000:2.0:1788869408.073325:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869408.073356:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325016832 00000100:00100000:2.0:1788869408.073361:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325016832 00000100:00100000:2.0:1788869408.073393:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325017344 00000100:00100000:2.0:1788869408.073396:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325017344 00000100:00100000:2.0:1788869408.073412:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869408.073418:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325016832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869408.073562:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325016832:12345-0@lo:400:kworker.0 Request processed in 143us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869408.073569:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869408.073608:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869408.073615:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325017344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869408.073643:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325017344:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869408.073661:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788869408.073678:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869408.073681:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869408.073700:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcca80 x1875765325016832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869408.073711:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325016832:0@lo:400:kworker.0 00010000:00080000:2.0:1788869408.073721:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8fb80 x1875765325017344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869408.073730:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325017344:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.076411:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325016192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.076495:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869408.076824:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325016704:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.076859:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869408.076882:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325017216:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.076908:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869408.076964:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325015936 00000100:00100000:1.0:1788869408.076973:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325015936 00000100:00100000:1.0:1788869408.077042:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788869408.077081:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325015936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077148:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325015936:12345-0@lo:400:kworker.0 Request processed in 80us (5726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869408.077157:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788869408.077221:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325016064 00000100:00100000:1.0:1788869408.077226:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325016064 00000100:00100000:1.0:1788869408.077246:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325016320 00000100:00100000:1.0:1788869408.077249:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325016320 00000100:00100000:1.0:1788869408.077261:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325016704 00000100:00100000:1.0:1788869408.077264:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325016704 00000100:00100000:1.0:1788869408.077287:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325017216 00000100:00100000:1.0:1788869408.077290:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325017216 00000100:00100000:1.0:1788869408.077317:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869408.077324:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325016064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077359:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325016064:12345-0@lo:400:kworker.0 Request processed in 36us (5914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869408.077366:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869408.077382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788869408.077388:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077425:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325016320:12345-0@lo:400:kworker.0 Request processed in 37us (5878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869408.077431:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788869408.077446:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869408.077453:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325016704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077486:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325016704:12345-0@lo:400:kworker.0 Request processed in 34us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869408.077491:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869408.077513:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788869408.077519:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325017216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077549:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325017216:12345-0@lo:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869408.077555:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788869408.077683:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325015936:0@lo:400:kworker.0 00010000:00080000:1.0:1788869408.077740:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcc380 x1875765325016704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869408.077754:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325016704:0@lo:400:kworker.0 00010000:00080000:1.0:1788869408.077766:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcf480 x1875765325017216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869408.077775:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325017216:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077802:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325016064:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077813:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325016576:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077845:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869408.077865:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325016576 00000100:00100000:1.0:1788869408.077869:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325016576 00000100:00100000:1.0:1788869408.077894:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869408.077900:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325016576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077929:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325016576:12345-0@lo:400:kworker.0 Request processed in 29us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869408.077935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869408.077966:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325016576:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.077984:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325017088:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.078010:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869408.078030:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325017088 00000100:00100000:1.0:1788869408.078034:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325017088 00000100:00100000:1.0:1788869408.078060:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788869408.078066:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325017088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.078098:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325017088:12345-0@lo:400:kworker.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869408.078103:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788869408.078130:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325017088:0@lo:400:kworker.0 00000100:00100000:2.0:1788869408.078800:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325016192 00000100:00100000:2.0:1788869408.078808:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325016192 00000100:00100000:2.0:1788869408.078850:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788869408.078936:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325016192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788869408.079151:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869408.079163:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869408.079517:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325016192:12345-0@lo:400:kworker.0 Request processed in 583us (3022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869408.079525:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788869408.082546:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325016192:0@lo:400:kworker.0 00000100:00100000:3.0:1788869408.083086:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325016320:0@lo:400:kworker.0 00000100:00100000:1.0:1788869408.581900:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325017600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869408.581994:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869408.582077:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325017600 00000100:00100000:1.0:1788869408.582085:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325017600 00000100:00100000:1.0:1788869408.582142:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869408.582151:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325017600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869408.582182:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869408.582226:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325017600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869408.582232:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788869408.582471:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db35f80 x1875765325017600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869408.582493:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325017600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869408.585315:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869408.585342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325017728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869408.585420:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869408.591911:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325017728 00000100:00100000:1.0:1788869408.591929:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325017728 00000100:00100000:1.0:1788869408.592001:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869408.592012:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325017728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869408.592039:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869408.593786:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325017728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1765us (8355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869408.593800:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788869408.595124:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a30a80 x1875765325017728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869408.595156:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325017728:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788869408.972854:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869410.000056:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869410.117863:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325017856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869410.117946:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869410.118087:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325017856 00000100:00100000:2.0:1788869410.118097:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325017856 00000100:00100000:2.0:1788869410.118156:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788869410.118167:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325017856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869410.118204:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869410.118276:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325017856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869410.118284:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869410.120780:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325017856:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788869410.813817:0:10946:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing yml_node 00010000:00010000:2.0:1788869411.015323:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869411.142467:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325018112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869411.142467:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325017984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869411.142838:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869411.142912:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325017984 00000100:00100000:3.0:1788869411.142923:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325017984 00000100:00080000:0.0:1788869411.142954:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869411.142995:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869411.143006:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325017984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869411.143040:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869411.143104:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325017984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869411.143112:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788869411.143207:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111d180 x1875765325017984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869411.143227:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325017984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869411.149782:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869411.156118:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325018112 00000100:00100000:3.0:1788869411.156141:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325018112 00000100:00100000:3.0:1788869411.156241:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788869411.156251:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325018112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869411.156422:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869411.156583:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325018112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 332us (6806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869411.156610:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788869411.158968:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869411.165654:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a32d80 x1875765325018112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869411.165686:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325018112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869411.775871:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869411.775920:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869411.775950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869411.775985:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305025536 00000100:00100000:1.0:1788869411.775999:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305025536 00000100:00100000:2.0:1788869411.776246:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305025664 00000100:00100000:2.0:1788869411.776253:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305025664 00000100:00100000:2.0:1788869411.776308:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:2.0:1788869411.776320:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305025664:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869411.776413:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305025664:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 95us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869411.776551:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1788869411.776964:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1788869411.776974:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305025536:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869411.777011:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305025536:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 39us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869411.777017:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00080000:1.0:1788869411.777144:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869411.777149:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869411.777967:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305025408 00000100:00100000:1.0:1788869411.777991:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305025408 00000100:00100000:1.0:1788869411.778059:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 281 00000100:00100000:1.0:1788869411.778068:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305025408:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869411.778121:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305025408:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 54us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869411.778128:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 281 00010000:00010000:3.0:1788869412.038774:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869412.169660:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325018240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869412.169768:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1788869412.172621:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:2.0:1788869412.172635:0:9520:0:(genops.c:885:class_export_put()) final put ffff8e2702742800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:0.0:1788869412.173029:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2702742800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d for lustre-OST0001 00000020:00000080:0.0:1788869412.173108:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2702745800 for lustre-OST0001 00000100:00100000:1.0:1788869412.175832:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325018240 00000100:00100000:1.0:1788869412.175852:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325018240 00000100:00100000:1.0:1788869412.175934:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788869412.175947:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325018240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869412.175994:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869412.176097:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325018240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (6329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869412.176105:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788869412.176185:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325018240:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788869412.183252:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:1.0:1788869412.183267:0:8435:0:(genops.c:885:class_export_put()) final put ffff8e282dbaa800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:0.0:1788869412.183384:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282dbaa800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d for lustre-OST0000 00000020:00000080:0.0:1788869412.183526:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e283b46e800 for lustre-OST0000 00010000:00010000:1.0:1788869413.066642:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869413.190258:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325018624:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.190616:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325018368:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.190679:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.190737:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325018880:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.190765:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.190785:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325019392:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.190810:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.190828:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325019904:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.190870:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.190912:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869413.190920:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325018496:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.190968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.190996:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325019008:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.191017:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.191034:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325019520:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.191053:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.191081:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325018752:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.191103:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.191123:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325019264:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.191143:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.191162:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325019776:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.191183:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.191233:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325018368 00000100:00100000:1.0:1788869413.191242:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325018368 00000100:00100000:1.0:1788869413.191288:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788869413.191298:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325018368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.192531:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325018368:12345-0@lo:400:kworker.0 Request processed in 1224us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869413.192547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788869413.192645:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325018880 00000100:00100000:1.0:1788869413.192653:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325018880 00000100:00100000:1.0:1788869413.192688:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869413.192696:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325018880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.192762:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325018880:12345-0@lo:400:kworker.0 Request processed in 67us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869413.192769:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869413.192792:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325018496 00000100:00100000:1.0:1788869413.192797:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325018496 00000100:00100000:1.0:1788869413.192817:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325019008 00000100:00100000:1.0:1788869413.192821:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325019008 00000100:00100000:1.0:1788869413.192844:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325019520 00000100:00100000:1.0:1788869413.192847:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325019520 00000100:00100000:1.0:1788869413.192860:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325018752 00000100:00100000:1.0:1788869413.192863:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325018752 00000100:00100000:1.0:1788869413.192877:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788869413.192882:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325018496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.193488:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325019392 00000100:00100000:2.0:1788869413.193495:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325019392 00000100:00100000:2.0:1788869413.193522:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325019904 00000100:00100000:2.0:1788869413.193525:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325019904 00000100:00100000:2.0:1788869413.193538:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325019264 00000100:00100000:2.0:1788869413.193540:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325019264 00000100:00100000:2.0:1788869413.193552:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325019776 00000100:00100000:2.0:1788869413.193554:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325019776 00000100:00100000:2.0:1788869413.193581:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869413.193617:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325019392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.193700:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325019392:12345-0@lo:400:kworker.0 Request processed in 112us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869413.193707:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869413.193723:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869413.193729:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325019904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.193755:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325019904:12345-0@lo:400:kworker.0 Request processed in 27us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869413.193760:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869413.193770:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869413.193775:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325019264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.193807:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325019264:12345-0@lo:400:kworker.0 Request processed in 33us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869413.193812:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869413.193822:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869413.193829:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325019776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.193856:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325019776:12345-0@lo:400:kworker.0 Request processed in 29us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869413.193862:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869413.193884:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869413.193892:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325019008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.193923:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325019008:12345-0@lo:400:kworker.0 Request processed in 32us (2905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869413.193929:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869413.193959:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788869413.193966:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325019520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.193999:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325019520:12345-0@lo:400:kworker.0 Request processed in 33us (2945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869413.194005:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788869413.194020:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788869413.194026:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325018752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.194067:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325018752:12345-0@lo:400:kworker.0 Request processed in 41us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869413.194073:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788869413.194177:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325018496:0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.194188:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325019008:0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.194208:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325019520:0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.194217:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325018368:0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.194226:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325018880:0@lo:400:kworker.0 00010000:00080000:2.0:1788869413.194238:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d6680 x1875765325019392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869413.194249:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325019392:0@lo:400:kworker.0 00010000:00080000:2.0:1788869413.194258:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f0b100 x1875765325019904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869413.194266:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325019904:0@lo:400:kworker.0 00000100:00080000:2.0:1788869413.194304:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869413.194313:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869413.194316:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869413.194351:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325018752:0@lo:400:kworker.0 00010000:00080000:2.0:1788869413.194361:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d6a00 x1875765325019264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869413.194370:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325019264:0@lo:400:kworker.0 00010000:00080000:2.0:1788869413.194379:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f0a680 x1875765325019776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869413.194386:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325019776:0@lo:400:kworker.0 00000100:00100000:1.0:1788869413.194979:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325018496:12345-0@lo:400:kworker.0 Request processed in 31us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869413.194988:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788869413.195502:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869413.195559:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325019136:0@lo:400:kworker.0 00000100:00100000:0.0:1788869413.195624:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869413.195645:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325019648:0@lo:400:kworker.0 00000100:00100000:0.0:1788869413.195667:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869413.195705:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325019136 00000100:00100000:0.0:1788869413.195713:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325019136 00000100:00100000:0.0:1788869413.195758:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325019648 00000100:00100000:0.0:1788869413.195760:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325019648 00000100:00100000:0.0:1788869413.195779:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788869413.195786:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325019136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869413.195834:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325019136:12345-0@lo:400:kworker.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869413.195840:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788869413.195853:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788869413.195859:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325019648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869413.195887:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325019648:12345-0@lo:400:kworker.0 Request processed in 28us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869413.195893:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788869413.195911:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788869413.195942:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d4a80 x1875765325019136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869413.195953:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325019136:0@lo:400:kworker.0 00010000:00080000:0.0:1788869413.195979:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f0b480 x1875765325019648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869413.195987:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325019648:0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.197311:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325018624 00000100:00100000:2.0:1788869413.197323:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325018624 00000100:00100000:2.0:1788869413.197384:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869413.197393:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325018624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.197487:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325018624:12345-0@lo:400:kworker.0 Request processed in 95us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869413.197494:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788869413.197829:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325018624:0@lo:400:kworker.0 00000100:00100000:2.0:1788869413.705095:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325020032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869413.705205:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869413.705522:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325020032 00000100:00100000:1.0:1788869413.705532:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325020032 00000100:00100000:1.0:1788869413.705607:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869413.705619:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325020032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869413.705661:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869413.705724:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325020032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869413.705731:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788869413.707857:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27038eb800 x1875765325020032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869413.707884:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325020032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869413.707928:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869413.707950:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325020160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869413.708016:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869413.708337:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325020160 00000100:00100000:3.0:1788869413.708345:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325020160 00000100:00100000:3.0:1788869413.708410:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788869413.708420:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325020160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869413.708453:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869413.708511:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325020160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869413.708518:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788869413.709075:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f0b480 x1875765325020160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869413.709097:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325020160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788869414.088268:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869415.110881:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869415.240582:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325020288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869415.240694:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869415.241907:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325020288 00000100:00100000:2.0:1788869415.241924:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325020288 00000100:00100000:2.0:1788869415.242008:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788869415.242028:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325020288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869415.242072:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869415.242167:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325020288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869415.242175:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869415.242495:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325020288:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869416.134730:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869416.263424:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325020416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869416.263527:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869416.263772:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325020416 00000100:00100000:0.0:1788869416.263784:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325020416 00000100:00100000:0.0:1788869416.263863:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788869416.263875:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325020416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869416.263907:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869416.263960:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325020416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869416.263967:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788869416.264163:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869416.264199:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f08380 x1875765325020416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869416.264222:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325020416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869416.264438:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325020544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869416.264489:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869416.264789:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325020544 00000100:00100000:0.0:1788869416.264794:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325020544 00000100:00100000:0.0:1788869416.264842:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869416.264849:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325020544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869416.264862:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869416.264899:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325020544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869416.264913:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788869416.264942:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f08e00 x1875765325020544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869416.264956:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325020544:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869416.265046:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788869416.671647:0:11130:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:3.0:1788869416.897881:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869416.897922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869416.897946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869416.897972:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305025920 00000100:00100000:3.0:1788869416.897981:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305025920 00000100:00100000:3.0:1788869416.898037:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305026048 00000100:00100000:3.0:1788869416.898041:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305026048 00000100:00100000:3.0:1788869416.898080:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:3.0:1788869416.898089:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305025920:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869416.898169:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305025920:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 81us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869416.898177:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:3.0:1788869416.898204:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1788869416.898210:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305026048:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869416.898234:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305026048:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869416.898240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1788869416.898421:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305025792 00000100:00100000:3.0:1788869416.898426:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305025792 00000100:00100000:3.0:1788869416.898452:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00100000:3.0:1788869416.898458:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:2409:x1875765305025792:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869416.898495:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:2409:x1875765305025792:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869416.898501:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00080000:3.0:1788869416.898527:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869416.898530:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788869417.158886:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869417.288031:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869417.288054:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325020672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869417.288206:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869417.288278:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325020672 00000100:00100000:0.0:1788869417.288287:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325020672 00000100:00100000:0.0:1788869417.288338:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788869417.288348:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325020672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869417.288389:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869417.288488:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325020672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869417.288495:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788869417.288545:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325020672:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869418.181937:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869418.310265:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325020928:0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.310350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869418.310429:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325021440:0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.310452:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869418.310477:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325021952:0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.310497:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869418.310528:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788869418.310547:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325021056:0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.310573:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869418.310617:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325021568:0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.310666:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869418.310684:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325022080:0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.310703:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869418.310730:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325020928 00000100:00100000:3.0:1788869418.310737:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325020928 00000100:00100000:3.0:1788869418.310775:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325021440 00000100:00100000:3.0:1788869418.310778:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325021440 00000100:00100000:3.0:1788869418.310801:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325021952 00000100:00100000:3.0:1788869418.310804:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325021952 00000100:00100000:3.0:1788869418.310817:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325021568 00000100:00100000:3.0:1788869418.310819:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325021568 00000100:00100000:3.0:1788869418.310829:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325022080 00000100:00100000:3.0:1788869418.310831:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325022080 00000100:00100000:3.0:1788869418.310846:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788869418.310855:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325020928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.310906:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325020928:12345-0@lo:400:kworker.0 Request processed in 52us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869418.310913:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788869418.310944:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788869418.310950:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325021440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.310976:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325021440:12345-0@lo:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869418.310981:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788869418.311006:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869418.311012:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325021952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.311035:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325021952:12345-0@lo:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869418.311065:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869418.311215:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869418.311223:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325021568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.311253:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325021568:12345-0@lo:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869418.311258:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869418.311272:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788869418.311278:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325022080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.311301:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325022080:12345-0@lo:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869418.311307:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788869418.311340:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325021056 00000100:00100000:3.0:1788869418.311345:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325021056 00000100:00100000:3.0:1788869418.311373:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788869418.311380:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325021056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.311411:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325021056:12345-0@lo:400:kworker.0 Request processed in 32us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869418.311417:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788869418.311438:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869418.311443:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869418.311478:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325021056:0@lo:400:kworker.0 00010000:00080000:3.0:1788869418.311496:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d6680 x1875765325021568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869418.311506:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325021568:0@lo:400:kworker.0 00010000:00080000:3.0:1788869418.311516:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111d180 x1875765325022080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869418.311531:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325022080:0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.311544:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325020928:0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.311553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325021440:0@lo:400:kworker.0 00000100:00100000:3.0:1788869418.311575:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325021952:0@lo:400:kworker.0 00000100:00100000:1.0:1788869418.311792:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325021184:0@lo:400:kworker.0 00000100:00100000:1.0:1788869418.311849:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.311880:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325021696:0@lo:400:kworker.0 00000100:00100000:1.0:1788869418.311905:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.311941:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325022208:0@lo:400:kworker.0 00000100:00100000:1.0:1788869418.311963:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.311981:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788869418.311987:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325020800:0@lo:400:kworker.0 00000100:00100000:1.0:1788869418.312010:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.312027:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325021312:0@lo:400:kworker.0 00000100:00100000:1.0:1788869418.312049:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.312076:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325021824:0@lo:400:kworker.0 00000100:00100000:1.0:1788869418.312106:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.312121:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325022336:0@lo:400:kworker.0 00000100:00100000:1.0:1788869418.312154:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869418.312359:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325021312 00000100:00100000:0.0:1788869418.312366:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325021312 00000100:00100000:0.0:1788869418.312412:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788869418.312419:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325021312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869418.312467:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325021312:12345-0@lo:400:kworker.0 Request processed in 49us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.312474:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788869418.312503:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325021312:0@lo:400:kworker.0 00000100:00100000:2.0:1788869418.313166:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325021184 00000100:00100000:2.0:1788869418.313174:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325021184 00000100:00100000:2.0:1788869418.313215:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788869418.313221:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325021184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869418.313267:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325021184:12345-0@lo:400:kworker.0 Request processed in 46us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.313272:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788869418.313290:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325021696 00000100:00100000:2.0:1788869418.313294:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325021696 00000100:00100000:2.0:1788869418.313317:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325022208 00000100:00100000:2.0:1788869418.313320:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325022208 00000100:00100000:2.0:1788869418.313331:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325021824 00000100:00100000:2.0:1788869418.313334:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325021824 00000100:00100000:2.0:1788869418.313345:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325022336 00000100:00100000:2.0:1788869418.313347:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325022336 00000100:00100000:2.0:1788869418.313360:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869418.313365:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325021696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869418.313394:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325021696:12345-0@lo:400:kworker.0 Request processed in 28us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.313413:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869418.313423:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869418.313429:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325022208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869418.313469:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325022208:12345-0@lo:400:kworker.0 Request processed in 40us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.313475:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869418.313486:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788869418.313491:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325021824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869418.313516:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325021824:12345-0@lo:400:kworker.0 Request processed in 25us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.313521:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788869418.313531:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869418.313548:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325022336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869418.313573:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325022336:12345-0@lo:400:kworker.0 Request processed in 37us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.313579:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869418.313628:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325020800 00000100:00100000:2.0:1788869418.313632:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325020800 00000100:00100000:2.0:1788869418.313658:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788869418.313664:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325020800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869418.313696:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325020800:12345-0@lo:400:kworker.0 Request processed in 33us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.313701:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788869418.313750:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325020800:0@lo:400:kworker.0 00010000:00080000:2.0:1788869418.313776:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d7480 x1875765325021824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869418.313787:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325021824:0@lo:400:kworker.0 00010000:00080000:2.0:1788869418.313798:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f2680 x1875765325022336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869418.313805:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325022336:0@lo:400:kworker.0 00000100:00100000:2.0:1788869418.313816:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325021184:0@lo:400:kworker.0 00010000:00080000:2.0:1788869418.313826:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d4000 x1875765325021696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869418.313834:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325021696:0@lo:400:kworker.0 00010000:00080000:2.0:1788869418.313843:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f1180 x1875765325022208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869418.313850:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325022208:0@lo:400:kworker.0 00000100:00080000:3.0:1788869418.314205:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869418.314211:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869418.821970:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869418.822000:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325022464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869418.822073:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869418.822153:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325022464 00000100:00100000:0.0:1788869418.822163:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325022464 00000100:00100000:0.0:1788869418.822226:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788869418.822236:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325022464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869418.822267:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869418.822311:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325022464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.822317:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788869418.822362:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f08e00 x1875765325022464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869418.822380:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325022464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869418.830439:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325022592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869418.830511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869418.830826:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325022592 00000100:00100000:3.0:1788869418.830837:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325022592 00000100:00100000:3.0:1788869418.830885:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869418.830895:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325022592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869418.830935:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869418.831419:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325022592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 523us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869418.831427:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788869418.833786:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f3b80 x1875765325022592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869418.833814:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325022592:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869419.206275:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869419.471482:0:11227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1788869420.229865:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869420.357857:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325022720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869420.357943:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869420.358028:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325022720 00000100:00100000:2.0:1788869420.358037:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325022720 00000100:00100000:2.0:1788869420.358103:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788869420.358113:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325022720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869420.358155:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869420.358204:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325022720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869420.358229:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788869420.358282:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325022720:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869421.254612:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869421.382218:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325022848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869421.382303:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869421.382499:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325022848 00000100:00100000:0.0:1788869421.382509:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325022848 00000100:00100000:0.0:1788869421.382579:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788869421.382626:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325022848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869421.382660:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869421.382984:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325022976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869421.383017:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869421.383067:0:8444:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788869421.383076:0:8444:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:1.0:1788869421.383136:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869421.383548:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325022848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 959us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869421.383570:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788869421.383626:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325022976 00000100:00100000:0.0:1788869421.383632:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325022976 00000100:00100000:0.0:1788869421.383659:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788869421.383666:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325022976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869421.383681:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869421.383731:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325022976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869421.383736:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788869421.383780:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f046680 x1875765325022976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869421.383799:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325022976:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788869421.384217:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869421.389401:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f08700 x1875765325022848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869421.389430:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325022848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869422.014691:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869422.014736:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869422.014769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869422.015041:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305026304 00000100:00100000:0.0:1788869422.015053:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305026304 00000100:00100000:0.0:1788869422.015117:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305026432 00000100:00100000:0.0:1788869422.015120:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305026432 00000100:00100000:0.0:1788869422.015145:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1788869422.015155:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305026304:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869422.015244:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305026304:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 91us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869422.015252:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1788869422.015283:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:0.0:1788869422.015289:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305026432:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869422.015312:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305026432:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869422.015330:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00080000:0.0:1788869422.015360:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869422.015378:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869422.016045:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305026176 00000100:00100000:1.0:1788869422.016053:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305026176 00000100:00100000:1.0:1788869422.016099:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00100000:1.0:1788869422.016107:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2408:x1875765305026176:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869422.016148:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2408:x1875765305026176:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 42us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869422.016156:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 285 00010000:00010000:3.0:1788869422.280744:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869422.370037:0:11326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:0.0:1788869422.406541:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869422.406564:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325023104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869422.406701:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869422.406792:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325023104 00000100:00100000:0.0:1788869422.406800:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325023104 00000100:00100000:0.0:1788869422.407460:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788869422.407474:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325023104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869422.407511:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869422.407577:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325023104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869422.407613:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788869422.407775:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325023104:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869423.303958:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869423.430246:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325023232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869423.430360:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869423.430506:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325023232 00000100:00100000:0.0:1788869423.430519:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325023232 00000100:00100000:0.0:1788869423.430579:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788869423.430624:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325023232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869423.432385:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325023360:0@lo:400:kworker.0 00000100:00100000:2.0:1788869423.432478:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869423.432541:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325023360 00000100:00100000:2.0:1788869423.432549:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325023360 00000100:00100000:2.0:1788869423.432626:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788869423.432634:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325023360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869423.432684:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325023360:12345-0@lo:400:kworker.0 Request processed in 51us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869423.432691:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788869423.432739:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325023360:0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.443648:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325023232:12345-0@lo:400:kworker.0 Request processed in 13013us (13275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869423.443665:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788869423.444022:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325023872:0@lo:400:kworker.0 00000100:00100000:1.0:1788869423.444080:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869423.444110:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325024384:0@lo:400:kworker.0 00000100:00100000:1.0:1788869423.444137:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869423.444161:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869423.444167:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325023744:0@lo:400:kworker.0 00000100:00100000:1.0:1788869423.444191:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869423.444207:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325024256:0@lo:400:kworker.0 00000100:00100000:1.0:1788869423.444227:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869423.444244:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325024768:0@lo:400:kworker.0 00000100:00100000:1.0:1788869423.444262:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869423.444289:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325023872 00000100:00100000:1.0:1788869423.444298:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325023872 00000100:00100000:1.0:1788869423.444342:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325024384 00000100:00100000:1.0:1788869423.444345:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325024384 00000100:00100000:1.0:1788869423.444367:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788869423.444375:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325023872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869423.444418:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325023872:12345-0@lo:400:kworker.0 Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869423.444425:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788869423.444451:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788869423.444457:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325024384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869423.444479:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325024384:12345-0@lo:400:kworker.0 Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869423.444484:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788869423.444519:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325023744 00000100:00100000:1.0:1788869423.444522:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325023744 00000100:00100000:1.0:1788869423.444542:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869423.444548:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325023744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869423.444578:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325023744:12345-0@lo:400:kworker.0 Request processed in 31us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869423.444608:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869423.444628:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325024256 00000100:00100000:1.0:1788869423.444631:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325024256 00000100:00100000:1.0:1788869423.444650:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325024768 00000100:00100000:1.0:1788869423.444653:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325024768 00000100:00100000:1.0:1788869423.444669:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869423.444675:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325024256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869423.444736:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325023488:0@lo:400:kworker.0 00000100:00100000:2.0:1788869423.444771:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869423.444800:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325024000:0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.444806:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325023616:0@lo:400:kworker.0 00000100:00100000:2.0:1788869423.444842:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869423.444847:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325023488 00000100:00100000:0.0:1788869423.444852:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325023488 00000100:00100000:2.0:1788869423.444881:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325024512:0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.444884:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788869423.444895:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325023488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.444938:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325023488:12345-0@lo:400:kworker.0 Request processed in 45us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869423.444945:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788869423.444964:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869423.444982:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325024128:0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.445032:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869423.445045:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325024640:0@lo:400:kworker.0 00000100:00100000:2.0:1788869423.445061:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869423.445076:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869423.445107:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325023488:0@lo:400:kworker.0 00000100:00080000:0.0:1788869423.445128:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869423.445135:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869423.445139:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869423.445142:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325024128 00000100:00100000:2.0:1788869423.445147:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325024128 00000100:00100000:0.0:1788869423.445153:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325024640 00000100:00100000:0.0:1788869423.445159:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325024640 00000100:00100000:0.0:1788869423.445186:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869423.445192:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325024768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869423.445197:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788869423.445208:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325024128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.445228:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325024768:12345-0@lo:400:kworker.0 Request processed in 35us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869423.445235:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869423.445252:0:8743:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788869423.445259:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325024128:12345-0@lo:400:kworker.0 Request processed in 53us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869423.445261:0:8743:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788869423.445269:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788869423.445282:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325024000 00000100:00100000:0.0:1788869423.445286:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325024000 00000100:00100000:2.0:1788869423.445288:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788869423.445297:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325024640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.445310:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325023616 00000100:00100000:0.0:1788869423.445315:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325023616 00000100:00100000:0.0:1788869423.445327:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325024512 00000100:00100000:0.0:1788869423.445329:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325024512 00000100:00100000:0.0:1788869423.445341:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788869423.445347:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325024000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.453424:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325024000:12345-0@lo:400:kworker.0 Request processed in 8065us (8572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869423.458206:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788869423.458273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788869423.458294:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325023616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.458417:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325023616:12345-0@lo:400:kworker.0 Request processed in 135us (13452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869423.458425:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788869423.458437:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788869423.458460:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.458493:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325024512:12345-0@lo:400:kworker.0 Request processed in 36us (13435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869423.458499:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788869423.458645:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325023744:0@lo:400:kworker.0 00000100:00100000:1.0:1788869423.458743:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325024256:12345-0@lo:400:kworker.0 Request processed in 14066us (14512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869423.458753:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869423.458841:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325023616:0@lo:400:kworker.0 00010000:00080000:1.0:1788869423.458858:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f3800 x1875765325024128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869423.458869:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325024128:0@lo:400:kworker.0 00000100:00080000:1.0:1788869423.458906:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869423.458914:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869423.458918:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869423.458954:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f3100 x1875765325024000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869423.458965:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325024000:0@lo:400:kworker.0 00010000:00080000:1.0:1788869423.459009:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f2d80 x1875765325024512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869423.459018:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325024512:0@lo:400:kworker.0 00010000:00080000:0.0:1788869423.459569:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f2a00 x1875765325024768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869423.459619:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325024768:0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.459639:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325023872:0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.459652:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325024384:0@lo:400:kworker.0 00010000:00080000:0.0:1788869423.459681:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f1f80 x1875765325024256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869423.459750:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325024256:0@lo:400:kworker.0 00000100:00100000:2.0:1788869423.466656:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325024640:12345-0@lo:400:kworker.0 Request processed in 21347us (21567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869423.466672:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788869423.469451:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f2300 x1875765325024640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869423.469472:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325024640:0@lo:400:kworker.0 00000100:00100000:3.0:1788869423.471684:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325023232:0@lo:400:kworker.0 00000100:00100000:0.0:1788869423.941787:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325024896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869423.941871:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869423.942016:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325024896 00000100:00100000:0.0:1788869423.942024:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325024896 00000100:00100000:0.0:1788869423.942084:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788869423.942094:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325024896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869423.942125:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869423.942172:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325024896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869423.942178:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788869423.942219:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f08000 x1875765325024896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869423.942240:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325024896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869423.942701:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325025024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869423.942736:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869423.943167:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325025024 00000100:00100000:0.0:1788869423.943174:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325025024 00000100:00100000:0.0:1788869423.943203:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788869423.943210:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325025024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869423.943226:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869423.943264:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325025024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869423.943270:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788869423.943367:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f2300 x1875765325025024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869423.943382:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325025024:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788869424.293188:0:11375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 08:10:21 EDT 2026 00010000:00010000:2.0:1788869424.342426:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869425.357764:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869425.489160:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325025152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869425.489246:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869425.489379:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325025152 00000100:00100000:1.0:1788869425.489389:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325025152 00000100:00100000:1.0:1788869425.492640:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869425.492673:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325025152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869425.492720:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869425.492829:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325025152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869425.492836:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869425.492932:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325025152:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869426.373816:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869426.501863:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869426.501890:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325025280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869426.501998:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869426.502547:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325025280 00000100:00100000:2.0:1788869426.502557:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325025280 00000100:00100000:2.0:1788869426.502650:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788869426.502662:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325025280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869426.502695:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869426.502750:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325025280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869426.502757:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788869426.502855:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869426.502888:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f15500 x1875765325025280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869426.502907:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325025280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869426.505819:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869426.505842:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325025408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869426.505911:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869426.506620:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325025408 00000100:00100000:1.0:1788869426.506630:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325025408 00000100:00100000:1.0:1788869426.506687:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869426.506697:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325025408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869426.506719:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869426.506780:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325025408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869426.506788:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788869426.506855:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a30a80 x1875765325025408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869426.506875:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325025408:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788869426.512621:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869427.131963:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869427.132010:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869427.132038:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869427.132171:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305026688 00000100:00100000:0.0:1788869427.132184:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305026688 00000100:00100000:0.0:1788869427.132261:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305026816 00000100:00100000:0.0:1788869427.132265:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305026816 00000100:00100000:0.0:1788869427.132291:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1788869427.132301:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305026688:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869427.132402:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305026688:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 103us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869427.132410:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1788869427.132429:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:0.0:1788869427.132436:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305026816:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869427.132461:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305026816:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869427.132467:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:0.0:1788869427.132488:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305026560 00000100:00100000:0.0:1788869427.132492:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305026560 00000100:00100000:0.0:1788869427.132519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 287 00000100:00100000:0.0:1788869427.132525:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305026560:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869427.132548:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305026560:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869427.132555:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 287 00000100:00080000:3.0:1788869427.132838:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869427.132842:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788869427.397863:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869427.527583:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869427.527624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325025536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869427.527695:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869427.527760:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325025536 00000100:00100000:1.0:1788869427.527768:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325025536 00000100:00100000:1.0:1788869427.527807:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788869427.527815:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325025536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869427.527857:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869427.527930:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325025536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869427.527937:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788869427.527993:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325025536:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869428.424005:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869428.551740:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325026048:0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.551924:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325025664:0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.551958:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869428.552000:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325026176:0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.552021:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869428.552037:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325026688:0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.552060:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869428.552077:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325027200:0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.552096:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869428.552128:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325025792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.552160:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325026176 00000100:00100000:1.0:1788869428.552167:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325026176 00000100:00100000:1.0:1788869428.552210:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869428.552218:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325026176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.552285:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325026176:12345-0@lo:400:kworker.0 Request processed in 67us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869428.552293:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869428.552329:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325026688 00000100:00100000:1.0:1788869428.552332:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325026688 00000100:00100000:1.0:1788869428.552364:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325027200 00000100:00100000:1.0:1788869428.552367:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325027200 00000100:00100000:1.0:1788869428.552403:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788869428.552410:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325026688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.552440:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325026688:12345-0@lo:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869428.552447:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788869428.552460:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788869428.552466:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325027200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.552490:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325027200:12345-0@lo:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869428.552509:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788869428.552558:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325026176:0@lo:400:kworker.0 00010000:00080000:1.0:1788869428.552570:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcdc00 x1875765325026688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869428.552579:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325026688:0@lo:400:kworker.0 00010000:00080000:1.0:1788869428.552609:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcc380 x1875765325027200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869428.552617:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325027200:0@lo:400:kworker.0 00000100:00080000:1.0:1788869428.552659:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869428.552663:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869428.553321:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869428.553375:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325026560:0@lo:400:kworker.0 00000100:00100000:3.0:1788869428.553416:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869428.553432:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325027072:0@lo:400:kworker.0 00000100:00100000:3.0:1788869428.553457:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869428.553694:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325025664 00000100:00100000:0.0:1788869428.553702:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325025664 00000100:00100000:0.0:1788869428.553744:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788869428.553752:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325025664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869428.553803:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325025664:12345-0@lo:400:kworker.0 Request processed in 52us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869428.553823:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788869428.554332:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325025920:0@lo:400:kworker.0 00000100:00100000:2.0:1788869428.554390:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869428.554416:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325026432:0@lo:400:kworker.0 00000100:00100000:2.0:1788869428.554443:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869428.554463:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325026944:0@lo:400:kworker.0 00000100:00100000:2.0:1788869428.554482:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869428.554515:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325026560 00000100:00100000:2.0:1788869428.554519:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325026560 00000100:00100000:2.0:1788869428.554566:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325027072 00000100:00100000:2.0:1788869428.554570:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325027072 00000100:00100000:2.0:1788869428.554608:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788869428.554615:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325026560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869428.554658:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325026560:12345-0@lo:400:kworker.0 Request processed in 44us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869428.554664:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788869428.554678:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869428.554684:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325027072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869428.554710:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325027072:12345-0@lo:400:kworker.0 Request processed in 27us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869428.554716:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869428.554733:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325025920 00000100:00100000:2.0:1788869428.554736:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325025920 00000100:00100000:2.0:1788869428.554757:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788869428.554763:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808315050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325025920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869428.554798:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808315050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325025920:12345-0@lo:400:kworker.0 Request processed in 35us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869428.554803:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788869428.555422:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325026048 00000100:00100000:1.0:1788869428.555431:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325026048 00000100:00100000:1.0:1788869428.555462:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325026432 00000100:00100000:1.0:1788869428.555465:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325026432 00000100:00100000:1.0:1788869428.555480:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325026944 00000100:00100000:1.0:1788869428.555483:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325026944 00000100:00100000:1.0:1788869428.555497:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788869428.555514:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325026048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.555581:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325026048:12345-0@lo:400:kworker.0 Request processed in 68us (3771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869428.555611:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788869428.555641:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788869428.555648:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325026432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.555677:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325026432:12345-0@lo:400:kworker.0 Request processed in 30us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869428.555683:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788869428.555695:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788869428.555700:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325026944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.555724:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325026944:12345-0@lo:400:kworker.0 Request processed in 25us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869428.555730:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788869428.555757:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869428.555762:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869428.555764:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869428.555777:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869428.556297:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325026304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.556338:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869428.556353:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325026816:0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.556373:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869428.556413:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325025792 00000100:00100000:1.0:1788869428.556418:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325025792 00000100:00100000:1.0:1788869428.556437:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325026304 00000100:00100000:1.0:1788869428.556441:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325026304 00000100:00100000:1.0:1788869428.556458:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325026816 00000100:00100000:1.0:1788869428.556469:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325026816 00000100:00100000:1.0:1788869428.556488:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788869428.556494:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325025792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869428.556643:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788869428.556653:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325026304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869428.556703:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325026304:12345-0@lo:400:kworker.0 Request processed in 52us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869428.556710:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788869428.556729:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788869428.556734:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325026816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869428.556760:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325026816:12345-0@lo:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869428.556765:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788869428.556823:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325026304:0@lo:400:kworker.0 00000100:00100000:0.0:1788869428.556835:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325026816:0@lo:400:kworker.0 00000100:00100000:0.0:1788869428.556885:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325025664:0@lo:400:kworker.0 00000100:00080000:0.0:1788869428.556919:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869428.556957:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325026048:0@lo:400:kworker.0 00010000:00080000:0.0:1788869428.556973:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcfb80 x1875765325026560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869428.556986:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325026560:0@lo:400:kworker.0 00010000:00080000:0.0:1788869428.556998:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcf480 x1875765325027072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869428.557007:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325027072:0@lo:400:kworker.0 00000100:00100000:0.0:1788869428.557046:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325025920:0@lo:400:kworker.0 00010000:00080000:0.0:1788869428.557058:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcc700 x1875765325026432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869428.557081:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325026432:0@lo:400:kworker.0 00010000:00080000:0.0:1788869428.557094:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcd500 x1875765325026944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869428.557102:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325026944:0@lo:400:kworker.0 00000100:00100000:1.0:1788869428.558367:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325025792:12345-0@lo:400:kworker.0 Request processed in 1863us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869428.558379:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788869428.558951:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325025792:0@lo:400:kworker.0 00000100:00100000:0.0:1788869429.063886:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869429.063919:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325027328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869429.063994:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869429.064073:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325027328 00000100:00100000:0.0:1788869429.064083:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325027328 00000100:00100000:0.0:1788869429.064142:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788869429.064152:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325027328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869429.064188:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869429.064235:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325027328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869429.064244:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788869429.064284:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f08000 x1875765325027328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869429.064305:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325027328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869429.069172:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325027456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869429.069259:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869429.069384:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325027456 00000100:00100000:1.0:1788869429.069392:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325027456 00000100:00100000:1.0:1788869429.069439:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869429.069448:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325027456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869429.070497:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869429.077201:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325027456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7742us (7930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869429.077219:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788869429.079301:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcd500 x1875765325027456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869429.081112:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325027456:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869429.456808:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869430.472710:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869430.616056:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869430.616083:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325027584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869430.616159:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869430.616310:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325027584 00000100:00100000:1.0:1788869430.616318:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325027584 00000100:00100000:1.0:1788869430.616379:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788869430.616389:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325027584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869430.616432:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869430.616499:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325027584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869430.616506:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788869430.616572:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325027584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869431.501853:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869431.624808:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325027712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869431.624892:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869431.624981:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325027712 00000100:00100000:2.0:1788869431.624991:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325027712 00000100:00100000:2.0:1788869431.625050:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869431.625061:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325027712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869431.625100:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869431.625153:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325027712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869431.625160:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788869431.625184:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869431.625215:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f14000 x1875765325027712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869431.625235:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325027712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869431.625644:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869431.625657:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325027840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869431.625690:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869431.625729:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325027840 00000100:00100000:3.0:1788869431.625733:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325027840 00000100:00100000:3.0:1788869431.625784:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869431.625793:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325027840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869431.625808:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869431.625853:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325027840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869431.625859:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788869431.625874:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869431.625891:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcc700 x1875765325027840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869431.625904:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325027840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869432.251282:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869432.251334:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869432.251368:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869432.251392:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305027072 00000100:00100000:0.0:1788869432.251392:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305027200 00000100:00100000:1.0:1788869432.251403:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305027072 00000100:00100000:0.0:1788869432.251403:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305027200 00000100:00100000:0.0:1788869432.251490:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:0.0:1788869432.251502:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305027200:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869432.251579:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305027200:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869432.251707:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1788869432.255666:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305026944 00000100:00100000:3.0:1788869432.255683:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305026944 00000100:00100000:3.0:1788869432.255771:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:3.0:1788869432.255782:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2407:x1875765305026944:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869432.255868:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2407:x1875765305026944:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 87us (4533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869432.255875:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:1.0:1788869432.257379:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:1.0:1788869432.257397:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305027072:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869432.257475:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305027072:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 85us (6203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869432.257482:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00080000:1.0:1788869432.257524:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869432.257528:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869432.517869:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869432.645856:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869432.645880:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325027968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869432.645948:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869432.646215:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325027968 00000100:00100000:1.0:1788869432.646224:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325027968 00000100:00100000:1.0:1788869432.646278:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788869432.646287:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325027968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869432.646323:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869432.646385:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325027968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869432.646392:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788869432.646498:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325027968:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788869433.543012:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869433.671434:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325028096:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.671662:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.671710:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325028608:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.671736:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.671753:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325029120:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.671784:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.671814:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325029632:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.671834:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.671858:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788869433.671863:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325028224:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.671886:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.671900:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325028736:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.671918:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.671933:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325029248:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.671949:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.671976:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325028352:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.671999:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.672270:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325028864:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.672298:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.672313:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325029376:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.672330:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.672341:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788869433.672346:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325028480:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.672365:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.672374:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325028992:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.672391:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.672408:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325029504:0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.672426:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869433.672672:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325028096 00000100:00100000:3.0:1788869433.672688:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325028096 00000100:00100000:3.0:1788869433.672779:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788869433.672789:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325028096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869433.672860:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325028096:12345-0@lo:400:kworker.0 Request processed in 73us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869433.672867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788869433.672953:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325028224 00000100:00100000:0.0:1788869433.672958:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325028224 00000100:00100000:0.0:1788869433.672981:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325028736 00000100:00100000:0.0:1788869433.672984:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325028736 00000100:00100000:0.0:1788869433.673017:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325029248 00000100:00100000:0.0:1788869433.673020:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325029248 00000100:00100000:0.0:1788869433.673034:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325028864 00000100:00100000:0.0:1788869433.673036:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325028864 00000100:00100000:0.0:1788869433.673049:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325029376 00000100:00100000:0.0:1788869433.673052:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325029376 00000100:00100000:0.0:1788869433.673063:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325028480 00000100:00100000:0.0:1788869433.673066:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325028480 00000100:00100000:0.0:1788869433.673078:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788869433.673084:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325028224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869433.673124:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325028224:12345-0@lo:400:kworker.0 Request processed in 40us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869433.673138:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788869433.673165:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788869433.673171:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325028736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869433.673203:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325028736:12345-0@lo:400:kworker.0 Request processed in 33us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869433.673210:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788869433.673221:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788869433.673227:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325029248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869433.673253:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325029248:12345-0@lo:400:kworker.0 Request processed in 27us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869433.673259:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788869433.673270:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788869433.673275:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325028864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869433.673308:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325028864:12345-0@lo:400:kworker.0 Request processed in 32us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869433.673314:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788869433.673326:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788869433.673331:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325029376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869433.673355:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325029376:12345-0@lo:400:kworker.0 Request processed in 24us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869433.673361:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788869433.673372:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788869433.673378:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325028480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869433.673408:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325028480:12345-0@lo:400:kworker.0 Request processed in 30us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869433.673419:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788869433.674422:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325029120 00000100:00100000:2.0:1788869433.674432:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325029120 00000100:00100000:2.0:1788869433.674489:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325029632 00000100:00100000:2.0:1788869433.674494:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325029632 00000100:00100000:2.0:1788869433.674510:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325028992 00000100:00100000:2.0:1788869433.674514:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325028992 00000100:00100000:2.0:1788869433.674529:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325029504 00000100:00100000:2.0:1788869433.674543:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325029504 00000100:00100000:2.0:1788869433.674565:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869433.674573:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325029120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.674689:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325029120:12345-0@lo:400:kworker.0 Request processed in 117us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869433.674697:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869433.674712:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788869433.674718:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325029632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.674746:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325029632:12345-0@lo:400:kworker.0 Request processed in 29us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869433.674753:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788869433.674778:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869433.674784:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325028992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.674827:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325028992:12345-0@lo:400:kworker.0 Request processed in 43us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869433.674833:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869433.674845:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869433.674851:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325029504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.674878:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325029504:12345-0@lo:400:kworker.0 Request processed in 28us (2450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869433.674884:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869433.674905:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325028608 00000100:00100000:2.0:1788869433.674909:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325028608 00000100:00100000:2.0:1788869433.674933:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325028352 00000100:00100000:2.0:1788869433.674936:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325028352 00000100:00100000:2.0:1788869433.674949:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869433.674955:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325028608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.674995:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325028608:12345-0@lo:400:kworker.0 Request processed in 40us (3258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869433.675001:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869433.675027:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869433.675033:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325028352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.675060:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325028352:12345-0@lo:400:kworker.0 Request processed in 28us (3061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869433.675066:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869433.675141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325028224:0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.675833:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325028736:0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.675849:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325029248:0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.675861:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325028096:0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.675872:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325028608:0@lo:400:kworker.0 00010000:00080000:2.0:1788869433.675886:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a8000 x1875765325029120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869433.675897:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325029120:0@lo:400:kworker.0 00010000:00080000:2.0:1788869433.675906:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040ab100 x1875765325029632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869433.675914:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325029632:0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.675968:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325028480:0@lo:400:kworker.0 00010000:00080000:2.0:1788869433.675980:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcd500 x1875765325028992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869433.676001:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325028992:0@lo:400:kworker.0 00010000:00080000:2.0:1788869433.676327:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040aa680 x1875765325029504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869433.676336:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325029504:0@lo:400:kworker.0 00000100:00100000:2.0:1788869433.676347:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325028352:0@lo:400:kworker.0 00010000:00080000:2.0:1788869433.676359:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcdc00 x1875765325028864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869433.676367:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325028864:0@lo:400:kworker.0 00010000:00080000:2.0:1788869433.676377:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040ab480 x1875765325029376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869433.676385:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325029376:0@lo:400:kworker.0 00000100:00080000:2.0:1788869433.677174:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869433.677182:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869433.677184:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869433.677187:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869434.187684:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869434.187710:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325029760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869434.187784:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869434.187870:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325029760 00000100:00100000:2.0:1788869434.187888:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325029760 00000100:00100000:2.0:1788869434.187952:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788869434.187962:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325029760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869434.187995:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869434.188058:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325029760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869434.188065:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788869434.188120:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f14a80 x1875765325029760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869434.188140:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325029760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869434.203502:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869434.203533:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325029888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869434.203631:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869434.203688:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325029888 00000100:00100000:3.0:1788869434.203696:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325029888 00000100:00100000:3.0:1788869434.203743:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869434.203754:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325029888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869434.203777:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869434.203834:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325029888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869434.203841:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788869434.203892:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a9c00 x1875765325029888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869434.203914:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325029888:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869434.566252:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869435.592979:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869435.725088:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325030016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869435.725521:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869435.725673:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325030016 00000100:00100000:0.0:1788869435.725685:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325030016 00000100:00100000:0.0:1788869435.725750:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788869435.725770:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325030016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869435.725824:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869435.727484:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325030016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1709us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869435.727503:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788869435.727631:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325030016:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869436.614764:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869436.745301:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869436.745679:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325030144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869436.745765:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869436.745927:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869436.745940:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325030272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869436.745975:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869436.746010:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325030144 00000100:00100000:3.0:1788869436.746029:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325030144 00000100:00100000:3.0:1788869436.746093:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325030272 00000100:00100000:3.0:1788869436.746096:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325030272 00000100:00100000:2.0:1788869436.746270:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869436.746283:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325030144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869436.746315:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869436.746441:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325030144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869436.746449:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788869436.746471:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869436.746949:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a9c00 x1875765325030144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869436.746970:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325030144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869436.747057:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788869436.747066:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325030272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869436.747081:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869436.747321:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325030272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 255us (1343us total) trans 0 rc 0/0 00010000:00080000:2.0:1788869436.747424:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f14a80 x1875765325030272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869436.747439:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325030272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869436.747477:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788869437.375493:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869437.375541:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869437.375693:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305027328 00000100:00100000:1.0:1788869437.375704:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305027328 00000100:00100000:1.0:1788869437.375766:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 291 00000100:00100000:1.0:1788869437.375777:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305027328:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869437.375849:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305027328:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 74us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869437.375857:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 291 00000100:00100000:1.0:1788869437.377080:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869437.377139:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305027584 00000100:00100000:3.0:1788869437.377146:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305027584 00000100:00100000:3.0:1788869437.377194:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305027456 00000100:00100000:3.0:1788869437.377197:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305027456 00000100:00100000:3.0:1788869437.377215:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:3.0:1788869437.377222:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305027584:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869437.377270:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305027584:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 49us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869437.377276:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:3.0:1788869437.377288:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:3.0:1788869437.377293:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305027456:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869437.377323:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305027456:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869437.377328:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00080000:1.0:1788869437.377664:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869437.377668:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788869437.643384:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869437.767158:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325030400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869437.767238:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869437.767934:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325030400 00000100:00100000:3.0:1788869437.767956:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325030400 00000100:00100000:3.0:1788869437.768003:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869437.768012:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325030400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869437.768053:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869437.768111:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325030400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869437.768119:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788869437.768440:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325030400:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869438.662127:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869438.790812:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325030656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.790889:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869438.790936:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325031168:0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.790959:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869438.790986:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325031680:0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.791008:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869438.791033:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869438.791038:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325030784:0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.791079:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869438.791096:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325031296:0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.791114:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869438.791128:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325031808:0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.791146:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869438.791171:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325030656 00000100:00100000:2.0:1788869438.791179:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325030656 00000100:00100000:2.0:1788869438.791214:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325031168 00000100:00100000:2.0:1788869438.791217:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325031168 00000100:00100000:2.0:1788869438.791239:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325031680 00000100:00100000:2.0:1788869438.791242:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325031680 00000100:00100000:2.0:1788869438.791253:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325031296 00000100:00100000:2.0:1788869438.791255:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325031296 00000100:00100000:2.0:1788869438.791266:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325031808 00000100:00100000:2.0:1788869438.791268:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325031808 00000100:00100000:1.0:1788869438.791730:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325030528:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.791773:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869438.791826:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325031040:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.791864:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869438.791881:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325031552:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.791902:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869438.791919:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325032064:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.791937:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869438.791955:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869438.791961:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325030912:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.791985:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869438.791997:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325031424:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.792017:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869438.792033:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325031936:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.792054:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869438.793399:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788869438.793429:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325030656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.793533:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325030656:12345-0@lo:400:kworker.0 Request processed in 116us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.793541:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788869438.793572:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325030912 00000100:00100000:2.0:1788869438.793580:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325030912 00000100:00100000:2.0:1788869438.793621:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788869438.793632:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325031168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.793662:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325031168:12345-0@lo:400:kworker.0 Request processed in 33us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.793668:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788869438.793679:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788869438.793693:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325031680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.793738:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325031680:12345-0@lo:400:kworker.0 Request processed in 47us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.793744:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788869438.793757:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788869438.793764:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325031296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.793789:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325031296:12345-0@lo:400:kworker.0 Request processed in 26us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.793794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788869438.793804:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788869438.793809:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325031808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.793834:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325031808:12345-0@lo:400:kworker.0 Request processed in 25us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.793839:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788869438.793849:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869438.793853:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325030912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.793889:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325030912:12345-0@lo:400:kworker.0 Request processed in 35us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.793894:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869438.793924:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325030784 00000100:00100000:2.0:1788869438.793927:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325030784 00000100:00100000:2.0:1788869438.793953:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325031040 00000100:00100000:2.0:1788869438.793956:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325031040 00000100:00100000:2.0:1788869438.793969:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788869438.793974:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325030784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.794008:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325030784:12345-0@lo:400:kworker.0 Request processed in 34us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.794020:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788869438.794032:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869438.794036:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325031040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.794065:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325031040:12345-0@lo:400:kworker.0 Request processed in 28us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.794070:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788869438.794091:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869438.794096:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869438.794106:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325031552 00000100:00100000:2.0:1788869438.794110:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325031552 00000100:00100000:2.0:1788869438.794137:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325032064 00000100:00100000:2.0:1788869438.794140:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325032064 00000100:00100000:2.0:1788869438.794153:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325031424 00000100:00100000:2.0:1788869438.794155:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325031424 00000100:00100000:2.0:1788869438.794166:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325031936 00000100:00100000:2.0:1788869438.794168:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325031936 00000100:00100000:2.0:1788869438.794180:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869438.794185:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325031552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.794215:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325031552:12345-0@lo:400:kworker.0 Request processed in 31us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.794220:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869438.794230:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869438.794236:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325032064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.794259:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325032064:12345-0@lo:400:kworker.0 Request processed in 24us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.794264:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869438.794273:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788869438.794557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325030528 00000100:00100000:3.0:1788869438.794562:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325030528 00000100:00100000:3.0:1788869438.794633:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788869438.794641:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325030528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869438.794680:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325030528:12345-0@lo:400:kworker.0 Request processed in 40us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869438.794685:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788869438.795342:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325030784:0@lo:400:kworker.0 00010000:00080000:1.0:1788869438.795359:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcd500 x1875765325031296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869438.795369:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325031296:0@lo:400:kworker.0 00010000:00080000:1.0:1788869438.795381:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcc380 x1875765325031808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869438.795389:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325031808:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.795400:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325030656:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.795412:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325031168:0@lo:400:kworker.0 00000100:00100000:1.0:1788869438.795422:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325031680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869438.795758:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788869438.795773:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325031936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869438.796018:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325031936:12345-0@lo:400:kworker.0 Request processed in 249us (3960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869438.796026:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788869438.796080:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325030912:0@lo:400:kworker.0 00010000:00080000:3.0:1788869438.796093:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcfb80 x1875765325031936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869438.796104:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325031936:0@lo:400:kworker.0 00000100:00100000:3.0:1788869438.796114:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325030528:0@lo:400:kworker.0 00000100:00100000:3.0:1788869438.796139:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325031040:0@lo:400:kworker.0 00010000:00080000:3.0:1788869438.796149:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcc000 x1875765325031552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869438.796157:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325031552:0@lo:400:kworker.0 00010000:00080000:3.0:1788869438.796166:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e28179e4380 x1875765325032064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869438.796172:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325032064:0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.797486:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325031424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869438.797583:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325031424:12345-0@lo:400:kworker.0 Request processed in 3298us (5564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.797609:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788869438.797646:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869438.797652:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869438.797830:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcdf80 x1875765325031424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869438.797853:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325031424:0@lo:400:kworker.0 00000100:00100000:2.0:1788869439.305187:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325032192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869439.305252:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869439.305465:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325032192 00000100:00100000:2.0:1788869439.305474:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325032192 00000100:00100000:2.0:1788869439.305520:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869439.305529:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325032192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869439.305559:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869439.305624:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325032192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869439.305630:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788869439.305671:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e28179e6a00 x1875765325032192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869439.305769:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325032192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869439.307260:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325032320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869439.307327:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869439.307464:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325032320 00000100:00100000:1.0:1788869439.307470:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325032320 00000100:00100000:1.0:1788869439.307515:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869439.307523:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325032320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869439.307541:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869439.307581:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325032320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869439.307610:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788869439.309359:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d6a00 x1875765325032320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869439.309386:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325032320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788869439.685896:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869440.709861:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869440.839684:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869440.839714:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325032448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869440.839799:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869440.839946:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325032448 00000100:00100000:2.0:1788869440.839971:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325032448 00000100:00100000:2.0:1788869440.840032:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788869440.840043:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325032448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869440.840091:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869440.840155:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325032448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869440.840163:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788869440.840695:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325032448:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869441.734114:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869441.862022:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869441.862049:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325032576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869441.862124:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869441.862228:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325032704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869441.862250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869441.862319:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325032576 00000100:00100000:2.0:1788869441.862328:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325032576 00000100:00100000:2.0:1788869441.862385:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325032704 00000100:00100000:2.0:1788869441.862388:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325032704 00000100:00100000:2.0:1788869441.862405:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869441.862414:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325032576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869441.862444:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869441.862487:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325032576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869441.862494:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869441.862526:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869441.862533:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325032704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869441.862542:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869441.862566:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325032704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869441.862572:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788869441.862729:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869441.862760:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a8000 x1875765325032704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869441.862780:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325032704:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788869441.862805:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5f100 x1875765325032576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869441.862829:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325032576:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788869442.310754:0:12005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:10:39 (1788869439) === 00000100:00100000:1.0:1788869442.501045:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869442.501114:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305027840 00000100:00100000:2.0:1788869442.501124:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305027840 00000100:00100000:2.0:1788869442.501206:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:2.0:1788869442.501218:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305027840:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869442.501323:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305027840:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 107us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.501332:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00080000:3.0:1788869442.501561:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869442.506039:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869442.506092:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869442.506852:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305027712 00000100:00100000:1.0:1788869442.506867:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305027712 00000100:00100000:1.0:1788869442.506939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 293 00000100:00100000:1.0:1788869442.506950:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305027712:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869442.507035:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305027712:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 86us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869442.507044:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 293 00000100:00100000:2.0:1788869442.507560:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305027968 00000100:00100000:2.0:1788869442.507569:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305027968 00000100:00100000:2.0:1788869442.507657:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:2.0:1788869442.507665:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305027968:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869442.507713:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305027968:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 49us (1619us total) trans 0 rc 0/0 00000100:00080000:3.0:1788869442.507718:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869442.507720:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 145 00010000:00010000:3.0:1788869442.758712:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869442.887038:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869442.887062:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325032832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869442.887131:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869442.887293:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325032832 00000100:00100000:2.0:1788869442.887302:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325032832 00000100:00100000:2.0:1788869442.887355:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869442.887364:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325032832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869442.887399:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869442.887471:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325032832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.887477:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869442.887517:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325032832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869442.890032:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869442.890124:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305028096 00000100:00100000:1.0:1788869442.890135:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305028096 00000100:00100000:1.0:1788869442.890209:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 294 00000100:00100000:1.0:1788869442.890219:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+10:8750:x1875765305028096:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788869442.890238:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869442.890255:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6ce984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9cb5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.890283:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6ce984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cb5 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.890295:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6ce984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cb5 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.890304:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ec00, rc 0) 00000100:00100000:1.0:1788869442.890367:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+11:8750:x1875765305028096:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 150us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869442.890375:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 294 00000100:00100000:3.0:1788869442.896981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869442.897091:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305028224 00000100:00100000:2.0:1788869442.897102:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305028224 00000100:00100000:2.0:1788869442.897159:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 295 00000100:00100000:2.0:1788869442.897171:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+11:8750:x1875765305028224:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869442.897370:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+11:8750:x1875765305028224:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 200us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.897389:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 295 00000100:00100000:0.0:1788869442.914246:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869442.925523:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305028352 00000100:00100000:3.0:1788869442.925541:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305028352 00000100:00100000:3.0:1788869442.925639:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 296 00000100:00100000:3.0:1788869442.925652:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+11:8750:x1875765305028352:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788869442.925826:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+11:8750:x1875765305028352:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 176us (11592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.925835:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 296 00000100:00100000:0.0:1788869442.946666:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869442.946817:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305028480 00000100:00100000:3.0:1788869442.946831:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305028480 00000100:00100000:3.0:1788869442.946898:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 297 00000100:00100000:3.0:1788869442.946908:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+11:8754:x1875765305028480:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869442.947060:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+11:8754:x1875765305028480:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 152us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.947068:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 297 00000100:00100000:3.0:1788869442.989012:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869442.989248:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305028608 00000100:00100000:2.0:1788869442.989261:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305028608 00000100:00100000:2.0:1788869442.989323:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 298 00000100:00100000:2.0:1788869442.989334:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+11:8754:x1875765305028608:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869442.989507:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+11:8754:x1875765305028608:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 174us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.989515:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 298 00000100:00100000:1.0:1788869442.998405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869442.998519:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305028736 00000100:00100000:0.0:1788869442.998529:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305028736 00000100:00100000:0.0:1788869442.998638:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 299 00000100:00100000:0.0:1788869442.998648:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+11:8754:x1875765305028736:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869442.998826:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+11:8754:x1875765305028736:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 180us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.998835:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 299 00000100:00100000:0.0:1788869443.004686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869443.006031:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305028864 00000100:00100000:3.0:1788869443.006045:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305028864 00000100:00100000:3.0:1788869443.006133:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 300 00000100:00100000:3.0:1788869443.006144:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+11:8750:x1875765305028864:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869443.006162:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869443.006181:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe0c00/0x4c16c38a9b6ce98b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ce6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.006226:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe0c00/0x4c16c38a9b6ce98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ce6 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.006239:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe0c00/0x4c16c38a9b6ce98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ce6 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.006249:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe0c00, rc 0) 00000100:00100000:3.0:1788869443.006365:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+12:8750:x1875765305028864:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 222us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.006373:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 300 00000100:00100000:3.0:1788869443.011461:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869443.011580:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305028992 00000100:00100000:2.0:1788869443.011616:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305028992 00000100:00100000:2.0:1788869443.011729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 301 00000100:00100000:2.0:1788869443.011740:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+12:8750:x1875765305028992:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788869443.011770:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788869443.011795:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788869443.011799:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788869443.011802:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788869443.011805:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788869443.011807:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788869443.015863:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+12:8750:x1875765305028992:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 4114us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.015878:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 301 00000100:00100000:0.0:1788869443.020411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869443.020696:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305029120 00000100:00100000:3.0:1788869443.020707:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305029120 00000100:00100000:3.0:1788869443.020776:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 302 00000100:00100000:3.0:1788869443.020786:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+12:8750:x1875765305029120:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869443.020805:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869443.020823:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ced expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.020853:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ced expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.020887:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ced expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.020898:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe0000, rc 0) 00000100:00100000:3.0:1788869443.020957:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:8750:x1875765305029120:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 173us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.020965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 302 00000100:00100000:3.0:1788869443.024431:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869443.024529:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305029248 00000100:00100000:2.0:1788869443.024540:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305029248 00000100:00100000:2.0:1788869443.024632:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 303 00000100:00100000:2.0:1788869443.024643:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:8750:x1875765305029248:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869443.024833:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:8750:x1875765305029248:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 191us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.024841:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 303 00000100:00100000:0.0:1788869443.026973:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869443.027430:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305029376 00000100:00100000:1.0:1788869443.027441:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305029376 00000100:00100000:1.0:1788869443.027543:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 304 00000100:00100000:1.0:1788869443.027553:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:8750:x1875765305029376:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788869443.027768:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:8750:x1875765305029376:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 216us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869443.027777:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 304 00000100:00100000:0.0:1788869443.031162:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869443.032551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305029504 00000100:00100000:2.0:1788869443.032564:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305029504 00000100:00100000:2.0:1788869443.032645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:2.0:1788869443.032655:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:8758:x1875765305029504:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869443.032839:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:8758:x1875765305029504:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 185us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.032848:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:1.0:1788869443.041219:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869443.041548:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305029632 00000100:00100000:2.0:1788869443.041559:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305029632 00000100:00100000:2.0:1788869443.041695:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 306 00000100:00100000:2.0:1788869443.041706:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:8758:x1875765305029632:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869443.041992:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:8758:x1875765305029632:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 287us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.042000:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 306 00000100:00100000:0.0:1788869443.061646:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869443.061693:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869443.061730:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869443.061767:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869443.061810:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305029760 00000100:00100000:0.0:1788869443.061820:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305029760 00000100:00100000:0.0:1788869443.061855:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305030016 00000100:00100000:0.0:1788869443.061859:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305030016 00000100:00100000:0.0:1788869443.061867:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305030400 00000100:00100000:0.0:1788869443.061870:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305030400 00000100:00100000:0.0:1788869443.061893:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305030528 00000100:00100000:0.0:1788869443.061896:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305030528 00000100:00100000:0.0:1788869443.061912:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:0.0:1788869443.061922:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305030400:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869443.062009:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305030400:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.062017:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:0.0:1788869443.062056:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:0.0:1788869443.062063:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305030528:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869443.062092:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305030528:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.062099:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:0.0:1788869443.062120:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788869443.062125:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875765305029760:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788869443.062152:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from acc71e56-b348-418d-8d54-3ebb3639d490@192.168.204.54@tcp t0 exp 0000000000000000 cur 376 last 0 00000100:00100000:3.0:1788869443.062385:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788869443.062391:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1875765305030016:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788869443.062408:0:8260:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from acc71e56-b348-418d-8d54-3ebb3639d490@192.168.204.54@tcp t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:3.0:1788869443.062430:0:8260:0:(genops.c:1384:class_connect()) connect: client acc71e56-b348-418d-8d54-3ebb3639d490, cookie 0x4c16c38a9b6ce9a0 00000004:00100000:3.0:1788869443.062454:0:8260:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788869443.062568:0:8260:0:(import.c:65:import_set_state_nolock()) ffff8e2703411000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869443.062635:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:2406:x1875765305030016:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 231us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.062643:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000020:00000080:0.0:1788869443.063479:0:6526:0:(genops.c:1384:class_connect()) connect: client acc71e56-b348-418d-8d54-3ebb3639d490, cookie 0x4c16c38a9b6ce999 00000004:00100000:0.0:1788869443.063505:0:6526:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788869443.063619:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8e2703ac3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869443.063739:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+6:2406:x1875765305029760:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 1611us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.063749:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788869443.073046:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869443.073323:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305030144 00000100:00100000:2.0:1788869443.073336:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305030144 00000100:00100000:2.0:1788869443.073468:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788869443.073479:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:0:x1875765305030144:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788869443.073515:0:8260:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869443.073658:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:0:x1875765305030144:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 180us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.073682:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00080000:3.0:1788869443.073745:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869443.080409:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869443.082094:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869443.083182:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305029888 00000100:00100000:1.0:1788869443.083195:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305029888 00000100:00100000:1.0:1788869443.083304:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788869443.083314:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+6:0:x1875765305029888:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788869443.083359:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869443.083451:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+6:0:x1875765305029888:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 139us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869443.083457:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00080000:1.0:1788869443.083496:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869443.085386:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305030272 00000100:00100000:1.0:1788869443.085401:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305030272 00000100:00100000:1.0:1788869443.085460:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788869443.085471:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+6:8750:x1875765305030272:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788869443.085505:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869443.085583:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+6:8750:x1875765305030272:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 114us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869443.085605:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788869443.088453:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869443.088545:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305030656 00000100:00100000:3.0:1788869443.088556:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305030656 00000100:00100000:3.0:1788869443.088643:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788869443.088654:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:8750:x1875765305030656:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788869443.088810:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:8750:x1875765305030656:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 157us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.088836:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788869443.092486:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869443.092563:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869443.092682:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305030784 00000100:00100000:3.0:1788869443.092693:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305030784 00000100:00100000:3.0:1788869443.092751:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788869443.092759:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1875765305030784:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869443.092797:0:8743:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from acc71e56-b348-418d-8d54-3ebb3639d490@192.168.204.54@tcp t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:3.0:1788869443.092834:0:8743:0:(genops.c:1384:class_connect()) connect: client acc71e56-b348-418d-8d54-3ebb3639d490, cookie 0x4c16c38a9b6ce9a7 00002000:00100000:3.0:1788869443.092846:0:8743:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli acc71e56-b348-418d-8d54-3ebb3639d490/ffff8e2703411800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869443.092866:0:8743:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869443.092950:0:8743:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788869443.092978:0:8743:0:(import.c:65:import_set_state_nolock()) ffff8e2703412000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869443.093294:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305031040 00000100:00100000:2.0:1788869443.093300:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305031040 00000100:00100000:2.0:1788869443.093339:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1788869443.093347:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:acc71e56-b348-418d-8d54-3ebb3639d490+6:8750:x1875765305031040:12345-192.168.204.54@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788869443.093527:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:2406:x1875765305030784:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 766us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.093535:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788869443.093617:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869443.094998:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:acc71e56-b348-418d-8d54-3ebb3639d490+6:8750:x1875765305031040:12345-192.168.204.54@tcp:900:mount.lustre.0 Request processed in 1643us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.095011:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788869443.095327:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305030912 00000100:00100000:3.0:1788869443.095336:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305030912 00000100:00100000:3.0:1788869443.095404:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788869443.095411:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2406:x1875765305030912:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869443.095442:0:11338:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from acc71e56-b348-418d-8d54-3ebb3639d490@192.168.204.54@tcp t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:3.0:1788869443.095518:0:11338:0:(genops.c:1384:class_connect()) connect: client acc71e56-b348-418d-8d54-3ebb3639d490, cookie 0x4c16c38a9b6ce9ae 00002000:00100000:3.0:1788869443.095529:0:11338:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli acc71e56-b348-418d-8d54-3ebb3639d490/ffff8e2703414000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869443.095546:0:11338:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869443.095639:0:11338:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869443.095664:0:11338:0:(import.c:65:import_set_state_nolock()) ffff8e2703415000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869443.097495:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:acc71e56-b348-418d-8d54-3ebb3639d490+6:2406:x1875765305030912:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 2071us (3895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.097512:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1788869443.099116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869443.099202:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305031168 00000100:00100000:0.0:1788869443.099219:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305031168 00000100:00100000:0.0:1788869443.099280:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1788869443.099290:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc71e56-b348-418d-8d54-3ebb3639d490+6:8750:x1875765305031168:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788869443.099386:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788869443.099681:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc71e56-b348-418d-8d54-3ebb3639d490+6:8750:x1875765305031168:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 392us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.099688:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00010000:00010000:3.0:1788869443.790022:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869443.917053:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325033088:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917126:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917179:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325033600:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917448:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917481:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325034112:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917501:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917524:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788869443.917529:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325032960:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917572:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917630:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325033472:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917668:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917684:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325033984:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917784:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917805:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325034496:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917825:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917855:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325033216:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917879:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917897:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325033728:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917916:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917938:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325034240:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917957:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.917969:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869443.917975:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325033344:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.917995:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869443.918132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325032960 00000100:00100000:0.0:1788869443.918141:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325032960 00000100:00100000:1.0:1788869443.918364:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325033856:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.918392:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.918413:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325034368:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.918434:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.918462:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325033088 00000100:00100000:1.0:1788869443.918466:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325033088 00000100:00100000:1.0:1788869443.918492:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325033600 00000100:00100000:1.0:1788869443.918495:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325033600 00000100:00100000:1.0:1788869443.918519:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325034112 00000100:00100000:1.0:1788869443.918531:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325034112 00000100:00100000:1.0:1788869443.918549:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325033728 00000100:00100000:1.0:1788869443.918551:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325033728 00000100:00100000:1.0:1788869443.918562:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325034240 00000100:00100000:1.0:1788869443.918564:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325034240 00000100:00100000:1.0:1788869443.918574:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325033344 00000100:00100000:1.0:1788869443.918576:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325033344 00000100:00100000:1.0:1788869443.918619:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788869443.918629:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325033088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.918682:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325033088:12345-0@lo:400:kworker.0 Request processed in 55us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869443.918689:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788869443.918839:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788869443.918847:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325032960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869443.918881:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325032960:12345-0@lo:400:kworker.0 Request processed in 35us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.918887:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788869443.918918:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325033472 00000100:00100000:0.0:1788869443.918922:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325033472 00000100:00100000:0.0:1788869443.918943:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325033216 00000100:00100000:0.0:1788869443.918947:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325033216 00000100:00100000:0.0:1788869443.918958:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788869443.918963:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325033472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869443.918993:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325033472:12345-0@lo:400:kworker.0 Request processed in 29us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.918999:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788869443.919023:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788869443.919030:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325033216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869443.919063:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325033216:12345-0@lo:400:kworker.0 Request processed in 34us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.919068:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788869443.919109:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325033216:0@lo:400:kworker.0 00000100:00100000:0.0:1788869443.919154:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325033984 00000100:00100000:0.0:1788869443.919164:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325033984 00000100:00100000:0.0:1788869443.919388:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325034496 00000100:00100000:0.0:1788869443.919392:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325034496 00000100:00100000:0.0:1788869443.919407:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325033856 00000100:00100000:0.0:1788869443.919410:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325033856 00000100:00100000:0.0:1788869443.919421:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325034368 00000100:00100000:0.0:1788869443.919423:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325034368 00000100:00100000:0.0:1788869443.919436:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788869443.919442:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325033984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869443.919476:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325033984:12345-0@lo:400:kworker.0 Request processed in 33us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.919482:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788869443.919494:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869443.919499:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325034496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869443.919526:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325034496:12345-0@lo:400:kworker.0 Request processed in 27us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.919532:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869443.919543:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788869443.919548:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325033856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869443.919579:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325033856:12345-0@lo:400:kworker.0 Request processed in 30us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.919621:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788869443.919634:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788869443.919641:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325034368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869443.919669:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325034368:12345-0@lo:400:kworker.0 Request processed in 29us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.919675:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869443.919942:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788869443.919952:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325033600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869443.919989:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325033600:12345-0@lo:400:kworker.0 Request processed in 40us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.919995:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788869443.920025:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788869443.920032:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325034112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869443.920059:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325034112:12345-0@lo:400:kworker.0 Request processed in 29us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.920065:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788869443.920080:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788869443.920087:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325033728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869443.920116:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325033728:12345-0@lo:400:kworker.0 Request processed in 30us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.920121:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788869443.920135:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788869443.920148:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325034240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869443.920177:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325034240:12345-0@lo:400:kworker.0 Request processed in 29us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.920182:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788869443.920210:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788869443.920217:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325033344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869443.920243:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325033344:12345-0@lo:400:kworker.0 Request processed in 27us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.920248:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1788869443.922904:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869443.922914:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869443.922917:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869443.922920:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869443.922967:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325032960:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.922985:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325033472:0@lo:400:kworker.0 00010000:00080000:1.0:1788869443.922999:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcd500 x1875765325033984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869443.923009:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325033984:0@lo:400:kworker.0 00010000:00080000:1.0:1788869443.923019:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f14e00 x1875765325034496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869443.923027:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325034496:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.923037:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325033088:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.923048:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325033600:0@lo:400:kworker.0 00000100:00100000:1.0:1788869443.923079:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325034112:0@lo:400:kworker.0 00000100:00100000:3.0:1788869443.928796:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325033344:0@lo:400:kworker.0 00010000:00080000:3.0:1788869443.928817:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcc380 x1875765325033856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869443.928827:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325033856:0@lo:400:kworker.0 00010000:00080000:3.0:1788869443.928838:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f16a00 x1875765325034368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869443.928845:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325034368:0@lo:400:kworker.0 00010000:00080000:3.0:1788869443.928855:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcd880 x1875765325033728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869443.928862:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325033728:0@lo:400:kworker.0 00010000:00080000:3.0:1788869443.928872:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f15500 x1875765325034240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869443.928879:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325034240:0@lo:400:kworker.0 00000100:00100000:2.0:1788869444.422071:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325034624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869444.422148:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869444.422235:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325034624 00000100:00100000:2.0:1788869444.422243:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325034624 00000100:00100000:2.0:1788869444.422289:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788869444.422298:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c88ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325034624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869444.422324:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869444.422369:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c88ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325034624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869444.422376:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1788869444.422818:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5e300 x1875765325034624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869444.422839:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325034624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869444.422959:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869444.422971:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325034752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869444.423005:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869444.423040:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325034752 00000100:00100000:3.0:1788869444.423045:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325034752 00000100:00100000:3.0:1788869444.423073:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788869444.423080:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325034752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869444.423105:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869444.423137:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325034752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869444.423143:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1788869444.423171:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f059180 x1875765325034752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869444.423184:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325034752:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869444.806437:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869445.838264:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869445.957823:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869445.957846:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325034880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869445.957919:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869445.957990:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325034880 00000100:00100000:0.0:1788869445.957999:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325034880 00000100:00100000:0.0:1788869445.958048:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788869445.958057:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325034880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869445.958092:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869445.958139:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325034880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869445.958611:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788869445.958808:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325034880:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788869446.857001:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869446.985065:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869446.985090:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325035008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869446.985782:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869446.986367:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869446.986386:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325035136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869446.986426:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869446.986565:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325035008 00000100:00100000:3.0:1788869446.986574:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325035008 00000100:00100000:2.0:1788869446.986611:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325035136 00000100:00100000:2.0:1788869446.986615:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325035136 00000100:00080000:1.0:1788869446.986668:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869446.986746:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869446.986818:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325035136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869446.986851:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869446.987266:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325035136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 510us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869446.987276:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788869446.987545:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703947800 x1875765325035136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869446.987576:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325035136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869446.992074:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788869446.992091:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325035008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869446.992117:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869446.993422:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325035008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1330us (7635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869446.993435:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788869446.993649:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5e300 x1875765325035008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869446.993673:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325035008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869447.878461:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869448.006080:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325035264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869448.006170:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869448.006302:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325035264 00000100:00100000:2.0:1788869448.006311:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325035264 00000100:00100000:2.0:1788869448.006363:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788869448.006373:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325035264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869448.006408:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869448.006463:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325035264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869448.006470:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869448.006574:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325035264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869448.122180:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869448.122229:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869448.122260:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869448.122297:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869448.122322:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869448.122342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869448.122366:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869448.122395:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305032064 00000100:00100000:0.0:1788869448.122404:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305032064 00000100:00100000:0.0:1788869448.122460:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305031936 00000100:00100000:0.0:1788869448.122464:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305031936 00000100:00100000:0.0:1788869448.122491:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:0.0:1788869448.122502:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc71e56-b348-418d-8d54-3ebb3639d490+6:2407:x1875765305032064:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869448.122802:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc71e56-b348-418d-8d54-3ebb3639d490+6:2407:x1875765305032064:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 168us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869448.122818:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:0.0:1788869448.122838:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:0.0:1788869448.122844:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc71e56-b348-418d-8d54-3ebb3639d490+6:2407:x1875765305031936:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869448.122871:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc71e56-b348-418d-8d54-3ebb3639d490+6:2407:x1875765305031936:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869448.122877:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:0.0:1788869448.122896:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305031552 00000100:00100000:0.0:1788869448.122900:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305031552 00000100:00100000:0.0:1788869448.122922:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305031808 00000100:00100000:0.0:1788869448.122925:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305031808 00000100:00100000:0.0:1788869448.122934:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305031424 00000100:00100000:0.0:1788869448.122936:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305031424 00000100:00100000:0.0:1788869448.122946:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305031680 00000100:00100000:0.0:1788869448.122947:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305031680 00000100:00100000:0.0:1788869448.122959:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:0.0:1788869448.122964:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305031552:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869448.122989:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305031552:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869448.122996:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:0.0:1788869448.123006:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:0.0:1788869448.123012:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:2407:x1875765305031808:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869448.123033:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:2407:x1875765305031808:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869448.123048:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:0.0:1788869448.123061:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:0.0:1788869448.123067:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305031424:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869448.123091:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305031424:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869448.123097:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:0.0:1788869448.123107:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:0.0:1788869448.123113:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:2407:x1875765305031680:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869448.123140:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+6:2407:x1875765305031680:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869448.123145:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:1.0:1788869448.123245:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305031296 00000100:00100000:1.0:1788869448.123249:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305031296 00000100:00100000:1.0:1788869448.123282:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 308 00000100:00100000:1.0:1788869448.123288:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2407:x1875765305031296:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869448.123312:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2407:x1875765305031296:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869448.123319:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 308 00000100:00080000:1.0:1788869448.123359:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869448.123362:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869448.123364:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869448.123366:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788869448.902076:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869449.031809:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325035776:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.031884:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869449.031947:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325036288:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.031975:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869449.032001:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325036800:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032026:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869449.032053:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788869449.032060:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325035392:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032099:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869449.032127:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325035904:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032167:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869449.032168:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325035776 00000100:00100000:0.0:1788869449.032180:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325035776 00000100:00100000:1.0:1788869449.032190:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325036416:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032220:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869449.032232:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788869449.032243:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325035776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032245:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325036928:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032273:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869449.032309:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325036288 00000100:00100000:0.0:1788869449.032310:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325035776:12345-0@lo:400:kworker.0 Request processed in 68us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869449.032315:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325036288 00000100:00100000:0.0:1788869449.032321:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788869449.032349:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325035648:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032356:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325036800 00000100:00100000:1.0:1788869449.032360:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325036800 00000100:00100000:1.0:1788869449.032377:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325036416 00000100:00100000:1.0:1788869449.032380:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325036416 00000100:00100000:0.0:1788869449.032382:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869449.032401:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325036928 00000100:00100000:1.0:1788869449.032405:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325036928 00000100:00100000:0.0:1788869449.032409:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325036160:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032423:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788869449.032431:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325036288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869449.032438:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869449.032458:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325036672:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032495:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325036288:12345-0@lo:400:kworker.0 Request processed in 62us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869449.032496:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869449.032517:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788869449.032533:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788869449.032542:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325035520:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032550:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788869449.032570:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325036800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869449.032571:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869449.032628:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325036800:12345-0@lo:400:kworker.0 Request processed in 63us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869449.032634:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788869449.032650:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788869449.032656:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325036416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032682:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325036416:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869449.032688:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788869449.032699:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788869449.032705:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325036928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032728:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325036928:12345-0@lo:400:kworker.0 Request processed in 24us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869449.032733:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788869449.032758:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325035392 00000100:00100000:1.0:1788869449.032762:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325035392 00000100:00100000:1.0:1788869449.032787:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788869449.032793:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325035392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032821:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325035392:12345-0@lo:400:kworker.0 Request processed in 28us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869449.032827:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788869449.032853:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325035904 00000100:00100000:1.0:1788869449.032857:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325035904 00000100:00100000:1.0:1788869449.032876:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325035648 00000100:00100000:1.0:1788869449.032878:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325035648 00000100:00100000:1.0:1788869449.032890:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788869449.032896:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325035904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032936:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325035904:12345-0@lo:400:kworker.0 Request processed in 41us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869449.032942:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788869449.032957:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788869449.032963:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325035648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.032989:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325035648:12345-0@lo:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869449.032995:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869449.033020:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325036032:0@lo:400:kworker.0 00000100:00080000:1.0:1788869449.033029:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869449.033035:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869449.033055:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869449.033067:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325035392:0@lo:400:kworker.0 00000100:00100000:0.0:1788869449.033073:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325036544:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.033084:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325035904:0@lo:400:kworker.0 00010000:00080000:1.0:1788869449.033096:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f14380 x1875765325036416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869449.033106:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325036416:0@lo:400:kworker.0 00010000:00080000:1.0:1788869449.033115:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f16a00 x1875765325036928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869449.033123:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325036928:0@lo:400:kworker.0 00000100:00100000:1.0:1788869449.033133:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325035776:0@lo:400:kworker.0 00010000:00080000:1.0:1788869449.033143:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703944700 x1875765325036288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869449.033151:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325036288:0@lo:400:kworker.0 00010000:00080000:1.0:1788869449.033162:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f15500 x1875765325036800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869449.033177:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325036800:0@lo:400:kworker.0 00000100:00100000:3.0:1788869449.033197:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325036160 00000100:00100000:3.0:1788869449.033203:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325036160 00000100:00080000:1.0:1788869449.033222:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869449.033232:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325036672 00000100:00100000:3.0:1788869449.033236:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325036672 00000100:00100000:3.0:1788869449.033263:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325035520 00000100:00100000:3.0:1788869449.033266:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325035520 00000100:00100000:3.0:1788869449.033275:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325036032 00000100:00100000:3.0:1788869449.033277:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325036032 00000100:00100000:3.0:1788869449.033288:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869449.033300:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325036160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869449.033332:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325036160:12345-0@lo:400:kworker.0 Request processed in 33us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869449.033338:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869449.033350:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869449.033356:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325036672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869449.033380:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325036672:12345-0@lo:400:kworker.0 Request processed in 24us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869449.033385:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869449.033395:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869449.033401:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325035520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869449.033426:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325035520:12345-0@lo:400:kworker.0 Request processed in 25us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869449.033432:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869449.033441:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788869449.033447:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325036032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869449.033469:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325036032:12345-0@lo:400:kworker.0 Request processed in 23us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869449.033474:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1788869449.033531:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869449.033536:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869449.033753:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869449.033783:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325035648:0@lo:400:kworker.0 00010000:00080000:0.0:1788869449.033795:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703945880 x1875765325036160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869449.033803:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325036160:0@lo:400:kworker.0 00010000:00080000:0.0:1788869449.033812:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f16300 x1875765325036672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869449.033819:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325036672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869449.033838:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325035520:0@lo:400:kworker.0 00000100:00100000:0.0:1788869449.033847:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325036032:0@lo:400:kworker.0 00000100:00100000:0.0:1788869449.033868:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325036544 00000100:00100000:0.0:1788869449.033872:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325036544 00000100:00100000:0.0:1788869449.033904:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788869449.033909:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325036544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869449.033943:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325036544:12345-0@lo:400:kworker.0 Request processed in 34us (191us total) trans 0 rc 0/0 00000100:00080000:1.0:1788869449.034380:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869449.035119:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788869449.035252:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325036544:0@lo:400:kworker.0 00000001:00100000:1.0:1788869449.036854:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of acc71e56-b348-418d-8d54-3ebb3639d490 00000001:00100000:3.0:1788869449.037081:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of acc71e56-b348-418d-8d54-3ebb3639d490 00000001:00100000:3.0:1788869449.039111:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of acc71e56-b348-418d-8d54-3ebb3639d490 00000001:00100000:0.0:1788869449.042637:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of acc71e56-b348-418d-8d54-3ebb3639d490 00000100:00100000:0.0:1788869449.542129:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869449.542152:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325037056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869449.542228:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869449.543130:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325037056 00000100:00100000:0.0:1788869449.543142:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325037056 00000100:00100000:0.0:1788869449.543203:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788869449.543213:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325037056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869449.543244:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869449.543311:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325037056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869449.543318:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788869449.543358:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcdc00 x1875765325037056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869449.543376:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325037056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869449.545983:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869449.546009:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325037184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869449.546078:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869449.546237:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325037184 00000100:00100000:2.0:1788869449.546246:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325037184 00000100:00100000:2.0:1788869449.546302:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869449.546311:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325037184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869449.546331:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869449.546380:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325037184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869449.546387:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1788869449.550673:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcdc00 x1875765325037184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869449.550710:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325037184:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788869449.925712:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869449.932841:0:12198:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788869450.952562:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869451.077804:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869451.077827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325037312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869451.077893:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869451.078186:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325037312 00000100:00100000:0.0:1788869451.078194:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325037312 00000100:00100000:0.0:1788869451.078253:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788869451.078263:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325037312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869451.078301:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869451.078360:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325037312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869451.078383:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788869451.078446:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325037312:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869451.981839:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869452.102057:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325037440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869452.102148:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869452.102508:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325037440 00000100:00100000:1.0:1788869452.102517:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325037440 00000100:00100000:1.0:1788869452.102610:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788869452.102622:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325037440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869452.102657:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869452.102721:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325037440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869452.102728:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788869452.103064:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869452.103101:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f17480 x1875765325037440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869452.103135:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325037440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869452.103652:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325037568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869452.103707:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869452.103857:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325037568 00000100:00100000:1.0:1788869452.103864:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325037568 00000100:00100000:1.0:1788869452.103914:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788869452.103922:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325037568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869452.103936:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869452.103972:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325037568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869452.103977:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788869452.104569:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5d500 x1875765325037568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869452.104623:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325037568:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788869452.104819:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788869453.008175:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869453.135765:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325037696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869453.135884:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869453.138274:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325037696 00000100:00100000:1.0:1788869453.138291:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325037696 00000100:00100000:1.0:1788869453.138416:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788869453.138427:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325037696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869453.138495:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869453.145439:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325037696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6997us (9537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869453.145454:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788869453.162763:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325037696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869453.260630:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869453.260665:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869453.260696:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305032192 00000100:00100000:2.0:1788869453.260706:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305032192 00000100:00100000:2.0:1788869453.260764:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 310 00000100:00100000:2.0:1788869453.260775:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305032192:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869453.260841:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305032192:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.260849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 310 00000100:00100000:2.0:1788869453.260894:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869453.261019:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869453.261044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869453.261064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869453.261086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869453.261119:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305032320 00000100:00100000:2.0:1788869453.261124:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305032320 00000100:00100000:2.0:1788869453.261154:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305032448 00000100:00100000:2.0:1788869453.261171:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305032448 00000100:00100000:2.0:1788869453.261189:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305032704 00000100:00100000:2.0:1788869453.261191:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305032704 00000100:00100000:2.0:1788869453.261202:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305032576 00000100:00100000:2.0:1788869453.261205:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305032576 00000100:00100000:2.0:1788869453.261218:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:2.0:1788869453.261224:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305032320:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869453.261263:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305032320:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 39us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.261270:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:2.0:1788869453.261283:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:2.0:1788869453.261290:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305032448:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869453.261314:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305032448:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.261319:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:2.0:1788869453.261331:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:2.0:1788869453.261336:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305032704:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869453.261357:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305032704:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.261362:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:2.0:1788869453.261374:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1788869453.261379:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305032576:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869453.261400:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305032576:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.261405:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1788869453.261444:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305032960 00000100:00100000:2.0:1788869453.261448:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305032960 00000100:00100000:2.0:1788869453.261474:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305032832 00000100:00100000:2.0:1788869453.261477:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305032832 00000100:00100000:2.0:1788869453.261496:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:2.0:1788869453.261502:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305032960:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869453.261527:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305032960:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.261532:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:2.0:1788869453.261543:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:2.0:1788869453.261548:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305032832:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869453.261568:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305032832:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 20us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.261574:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00080000:2.0:1788869453.261618:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869453.261622:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869453.261625:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869453.261627:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869454.027907:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869454.163229:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325037952:0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.163307:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325038080:0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.163324:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869454.163363:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869454.163428:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325038592:0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.163481:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325038208:0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.163524:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325038080 00000100:00100000:2.0:1788869454.163531:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325038080 00000100:00100000:3.0:1788869454.163919:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325037824:0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.164000:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325038464:0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.164025:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869454.164046:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325038976:0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.164099:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869454.164165:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788869454.164193:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325037952 00000100:00100000:2.0:1788869454.164212:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325037952 00000100:00100000:2.0:1788869454.164266:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325038464 00000100:00100000:2.0:1788869454.164269:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325038464 00000100:00100000:2.0:1788869454.164290:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325038976 00000100:00100000:2.0:1788869454.164293:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325038976 00000100:00100000:2.0:1788869454.164307:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788869454.164313:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325037952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.164369:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325037952:12345-0@lo:400:kworker.0 Request processed in 56us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869454.164376:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788869454.164393:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788869454.164399:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325038464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.164438:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325038464:12345-0@lo:400:kworker.0 Request processed in 40us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869454.164444:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788869454.164478:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788869454.164486:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325038976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869454.164752:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869454.164780:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325038336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869454.164805:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869454.164822:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325038848:0@lo:400:kworker.0 00000100:00100000:3.0:1788869454.164843:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869454.164861:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325039360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869454.164881:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869454.164913:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325037824 00000100:00100000:3.0:1788869454.164917:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325037824 00000100:00100000:3.0:1788869454.164944:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788869454.164951:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325037824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869454.164987:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325037824:12345-0@lo:400:kworker.0 Request processed in 37us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869454.164993:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788869454.165017:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325038336 00000100:00100000:3.0:1788869454.165020:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325038336 00000100:00100000:3.0:1788869454.165041:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788869454.165046:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325038336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869454.165102:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325038336:12345-0@lo:400:kworker.0 Request processed in 56us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869454.165108:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788869454.165550:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325038976:12345-0@lo:400:kworker.0 Request processed in 1065us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869454.165557:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788869454.165761:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325038848 00000100:00100000:3.0:1788869454.165766:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325038848 00000100:00080000:0.0:1788869454.167046:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869454.167054:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869454.167090:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869454.167134:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325038720:0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.167180:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869454.167202:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325039232:0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.167225:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869454.167740:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325038208 00000100:00100000:2.0:1788869454.167748:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325038208 00000100:00100000:2.0:1788869454.167790:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788869454.167798:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325038208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.167855:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325038208:12345-0@lo:400:kworker.0 Request processed in 58us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869454.167862:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788869454.167894:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325039360 00000100:00100000:2.0:1788869454.167897:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325039360 00000100:00100000:3.0:1788869454.168891:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325037824:0@lo:400:kworker.0 00000100:00100000:3.0:1788869454.168909:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325038336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869454.168951:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325038720 00000100:00100000:3.0:1788869454.168956:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325038720 00000100:00080000:0.0:1788869454.169046:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869454.169051:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869454.172973:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869454.173036:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325039104:0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.173096:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869454.173141:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325038592 00000100:00100000:0.0:1788869454.173149:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325038592 00000100:00100000:0.0:1788869454.173197:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325039104 00000100:00100000:0.0:1788869454.173201:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325039104 00000100:00100000:0.0:1788869454.173218:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788869454.173226:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325038592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.173277:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325038592:12345-0@lo:400:kworker.0 Request processed in 52us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869454.173285:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788869454.173300:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788869454.173305:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325039104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.173330:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325039104:12345-0@lo:400:kworker.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869454.173336:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1788869454.173351:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869454.173362:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325038080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869454.173396:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325038080:12345-0@lo:400:kworker.0 Request processed in 9223us (10033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869454.173403:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788869454.173469:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325038080:0@lo:400:kworker.0 00010000:00080000:0.0:1788869454.173482:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a33800 x1875765325038592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869454.173493:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325038592:0@lo:400:kworker.0 00010000:00080000:0.0:1788869454.173513:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31880 x1875765325039104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869454.173522:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325039104:0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.174323:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325039232 00000100:00100000:2.0:1788869454.174331:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325039232 00000100:00100000:2.0:1788869454.174367:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788869454.174375:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325038848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.174449:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325038848:12345-0@lo:400:kworker.0 Request processed in 75us (9605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869454.174456:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788869454.174470:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869454.174476:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325039360:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788869454.174847:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a32300 x1875765325038848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869454.174860:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325038848:0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.174939:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325039360:12345-0@lo:400:kworker.0 Request processed in 463us (10056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869454.174946:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869454.174961:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788869454.174967:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325039232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.174997:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325039232:12345-0@lo:400:kworker.0 Request processed in 31us (7772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869454.175003:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1788869454.175506:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e28179e6a00 x1875765325039360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869454.175518:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325039360:0@lo:400:kworker.0 00000100:00100000:1.0:1788869454.175789:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325038208:0@lo:400:kworker.0 00010000:00080000:1.0:1788869454.175803:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e28179e4380 x1875765325039232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869454.175811:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325039232:0@lo:400:kworker.0 00000100:00100000:1.0:1788869454.175839:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325037952:0@lo:400:kworker.0 00000100:00100000:1.0:1788869454.175851:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325038464:0@lo:400:kworker.0 00000100:00100000:1.0:1788869454.175860:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325038976:0@lo:400:kworker.0 00000100:00080000:0.0:1788869454.176779:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869454.178314:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788869454.178341:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325038720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869454.178473:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325038720:12345-0@lo:400:kworker.0 Request processed in 147us (11292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869454.180982:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788869454.182013:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31c00 x1875765325038720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869454.182033:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325038720:0@lo:400:kworker.0 00000100:00100000:2.0:1788869454.661786:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869454.661830:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325039488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869454.661900:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869454.661972:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325039488 00000100:00100000:2.0:1788869454.661980:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325039488 00000100:00100000:2.0:1788869454.662027:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869454.662036:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325039488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869454.662066:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869454.662117:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325039488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869454.662124:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1788869454.662160:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2817951c00 x1875765325039488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869454.662177:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325039488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869454.667821:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869454.667844:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325039616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869454.667911:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869454.667968:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325039616 00000100:00100000:2.0:1788869454.667976:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325039616 00000100:00100000:2.0:1788869454.668033:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869454.668042:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325039616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869454.668063:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869454.668104:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325039616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869454.668111:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788869454.668146:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2817951c00 x1875765325039616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869454.668163:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325039616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788869455.047630:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869456.071190:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869456.202196:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869456.202218:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325039744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869456.202284:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869456.202351:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325039744 00000100:00100000:2.0:1788869456.202359:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325039744 00000100:00100000:2.0:1788869456.202431:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788869456.202788:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325039744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869456.202822:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869456.202973:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325039744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 533us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.202981:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788869456.211144:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325039744:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869457.097288:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869457.224149:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325039872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869457.224251:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869457.224620:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325039872 00000100:00100000:1.0:1788869457.224628:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325039872 00000100:00100000:1.0:1788869457.224687:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788869457.224697:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325039872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869457.224727:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869457.224790:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325039872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869457.224798:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1788869457.224851:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f15500 x1875765325039872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869457.224868:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325039872:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788869457.225578:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869457.226088:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325040000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869457.226147:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869457.227219:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325040000 00000100:00100000:2.0:1788869457.227230:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325040000 00000100:00100000:2.0:1788869457.227299:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788869457.227308:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325040000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869457.227332:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869457.227409:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325040000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869457.227416:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1788869457.227524:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2817952300 x1875765325040000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869457.227590:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325040000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869457.227655:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869458.119815:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869458.248862:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869458.248886:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325040128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869458.248963:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869458.249174:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325040128 00000100:00100000:0.0:1788869458.249183:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325040128 00000100:00100000:0.0:1788869458.249238:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788869458.249261:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325040128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869458.249294:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869458.249399:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325040128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869458.249406:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869458.251559:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325040128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869458.365175:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869458.365217:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869458.365240:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869458.365262:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869458.365283:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869458.365302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869458.365319:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869458.365357:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305033216 00000100:00100000:3.0:1788869458.365367:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305033216 00000100:00100000:3.0:1788869458.365416:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305033472 00000100:00100000:3.0:1788869458.365430:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305033472 00000100:00100000:3.0:1788869458.365448:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305033344 00000100:00100000:3.0:1788869458.365451:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305033344 00000100:00100000:3.0:1788869458.365462:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305033600 00000100:00100000:3.0:1788869458.365464:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305033600 00000100:00100000:1.0:1788869458.365568:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:1.0:1788869458.365581:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305033216:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869458.365671:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305033216:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 94us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869458.365678:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:1.0:1788869458.365696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:1.0:1788869458.365702:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305033472:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869458.365726:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305033472:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869458.365732:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:1.0:1788869458.365743:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:1.0:1788869458.365748:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305033344:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869458.365768:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305033344:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 20us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869458.365774:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:1.0:1788869458.365797:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:1.0:1788869458.365803:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305033600:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869458.365837:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305033600:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869458.365843:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:3.0:1788869458.366363:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305033728 00000100:00100000:3.0:1788869458.366369:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305033728 00000100:00100000:3.0:1788869458.366406:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305033856 00000100:00100000:3.0:1788869458.366409:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305033856 00000100:00100000:3.0:1788869458.366439:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:3.0:1788869458.366447:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305033728:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869458.366491:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305033728:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 44us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869458.366504:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:3.0:1788869458.366516:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:3.0:1788869458.366522:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305033856:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869458.366545:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305033856:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869458.366552:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:3.0:1788869458.366570:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305033088 00000100:00100000:3.0:1788869458.366573:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305033088 00000100:00100000:3.0:1788869458.366614:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 312 00000100:00100000:3.0:1788869458.366621:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305033088:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869458.366644:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305033088:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869458.366650:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 312 00000100:00080000:3.0:1788869458.366679:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869458.366683:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869458.366685:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869458.366688:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788869459.147717:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869459.270083:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325040512:0@lo:400:kworker.0 00000100:00100000:2.0:1788869459.270154:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869459.270212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325041024:0@lo:400:kworker.0 00000100:00100000:2.0:1788869459.270236:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869459.270257:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325041536:0@lo:400:kworker.0 00000100:00100000:2.0:1788869459.270275:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869459.270299:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788869459.270331:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325040384:0@lo:400:kworker.0 00000100:00100000:2.0:1788869459.270353:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869459.270370:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325040896:0@lo:400:kworker.0 00000100:00100000:2.0:1788869459.270387:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869459.270406:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325041408:0@lo:400:kworker.0 00000100:00100000:2.0:1788869459.270423:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869459.270447:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325040512 00000100:00100000:2.0:1788869459.270454:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325040512 00000100:00100000:2.0:1788869459.270498:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788869459.270507:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325040512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869459.270567:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325040512:12345-0@lo:400:kworker.0 Request processed in 61us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869459.270574:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788869459.270742:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325040640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.270785:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869459.270797:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325041152:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.270816:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869459.270841:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325041664:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.270870:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869459.270893:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788869459.270899:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325040256:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.270925:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869459.270948:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325040768:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.270968:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869459.270985:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325041280:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271004:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869459.271021:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325041792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271040:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869459.271068:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325041024 00000100:00100000:1.0:1788869459.271072:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325041024 00000100:00100000:1.0:1788869459.271108:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325041536 00000100:00100000:1.0:1788869459.271111:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325041536 00000100:00100000:1.0:1788869459.271124:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325040384 00000100:00100000:1.0:1788869459.271127:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325040384 00000100:00100000:1.0:1788869459.271137:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325040896 00000100:00100000:1.0:1788869459.271139:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325040896 00000100:00100000:1.0:1788869459.271163:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325041408 00000100:00100000:1.0:1788869459.271165:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325041408 00000100:00100000:1.0:1788869459.271176:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325040640 00000100:00100000:1.0:1788869459.271178:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325040640 00000100:00100000:1.0:1788869459.271190:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788869459.271196:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325041024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271231:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325041024:12345-0@lo:400:kworker.0 Request processed in 35us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271237:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788869459.271266:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788869459.271272:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271297:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325041536:12345-0@lo:400:kworker.0 Request processed in 26us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271303:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788869459.271327:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788869459.271333:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325040384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271361:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325040384:12345-0@lo:400:kworker.0 Request processed in 29us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271367:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788869459.271380:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788869459.271385:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325040896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271409:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325040896:12345-0@lo:400:kworker.0 Request processed in 25us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271414:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788869459.271426:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788869459.271432:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325041408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271469:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325041408:12345-0@lo:400:kworker.0 Request processed in 37us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271474:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788869459.271488:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788869459.271494:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325040640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271521:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325040640:12345-0@lo:400:kworker.0 Request processed in 28us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271527:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788869459.271548:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325041152 00000100:00100000:1.0:1788869459.271551:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325041152 00000100:00100000:1.0:1788869459.271572:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325041664 00000100:00100000:1.0:1788869459.271574:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325041664 00000100:00100000:1.0:1788869459.271635:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325041280 00000100:00100000:1.0:1788869459.271638:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325041280 00000100:00100000:1.0:1788869459.271647:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325041792 00000100:00100000:1.0:1788869459.271650:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325041792 00000100:00100000:1.0:1788869459.271661:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788869459.271665:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325041152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271694:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325041152:12345-0@lo:400:kworker.0 Request processed in 28us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271700:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788869459.271713:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869459.271718:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325041664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271742:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325041664:12345-0@lo:400:kworker.0 Request processed in 25us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271748:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869459.271760:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869459.271773:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325041280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271799:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325041280:12345-0@lo:400:kworker.0 Request processed in 28us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271804:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869459.271819:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788869459.271825:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325041792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271851:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325041792:12345-0@lo:400:kworker.0 Request processed in 26us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271856:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788869459.271875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325040256 00000100:00100000:1.0:1788869459.271878:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325040256 00000100:00100000:1.0:1788869459.271900:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788869459.271906:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325040256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.271936:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325040256:12345-0@lo:400:kworker.0 Request processed in 30us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.271942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788869459.271970:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325040768 00000100:00100000:1.0:1788869459.271974:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325040768 00000100:00100000:1.0:1788869459.271989:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788869459.271994:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325040768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.272022:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325040768:12345-0@lo:400:kworker.0 Request processed in 28us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869459.272027:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788869459.272052:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869459.272056:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869459.272058:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869459.272060:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869459.272099:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325040256:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.272113:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325040768:0@lo:400:kworker.0 00010000:00080000:1.0:1788869459.272124:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a8a80 x1875765325041280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869459.272134:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325041280:0@lo:400:kworker.0 00010000:00080000:1.0:1788869459.272144:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db35500 x1875765325041792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869459.272151:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325041792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.272162:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325040640:0@lo:400:kworker.0 00010000:00080000:1.0:1788869459.272171:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040aa680 x1875765325041152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869459.272178:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325041152:0@lo:400:kworker.0 00010000:00080000:1.0:1788869459.272188:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db34e00 x1875765325041664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869459.272195:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325041664:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.272300:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325040384:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.272312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325040896:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.272334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325041408:0@lo:400:kworker.0 00000100:00100000:1.0:1788869459.272345:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325040512:0@lo:400:kworker.0 00010000:00080000:1.0:1788869459.272355:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040ab480 x1875765325041024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869459.272371:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325041024:0@lo:400:kworker.0 00010000:00080000:1.0:1788869459.272385:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db36a00 x1875765325041536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869459.272393:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325041536:0@lo:400:kworker.0 00000100:00100000:0.0:1788869459.781872:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869459.781906:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325041920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869459.781977:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869459.782368:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325041920 00000100:00100000:2.0:1788869459.782378:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325041920 00000100:00100000:2.0:1788869459.782434:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788869459.782443:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325041920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869459.782471:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869459.782520:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325041920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869459.782527:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1788869459.782571:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703911f80 x1875765325041920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869459.782612:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325041920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869459.782996:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869459.783008:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325042048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869459.783042:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869459.784617:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325042048 00000100:00100000:3.0:1788869459.784630:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325042048 00000100:00100000:3.0:1788869459.784684:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788869459.784692:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325042048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869459.784714:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869459.784790:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325042048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869459.784797:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1788869459.785181:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f059880 x1875765325042048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869459.785201:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325042048:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869460.167797:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869460.862387:0:12514:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869460.862994:0:12514:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869461.190619:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869461.321069:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869461.321092:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325042176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869461.321159:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869461.321331:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325042176 00000100:00100000:0.0:1788869461.321342:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325042176 00000100:00100000:0.0:1788869461.321395:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788869461.321405:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325042176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869461.321439:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869461.321497:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325042176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869461.321504:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788869461.321714:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325042176:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788869462.219568:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869462.354896:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869462.354926:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325042304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869462.355014:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869462.355147:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325042432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869462.355155:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325042304 00000100:00100000:3.0:1788869462.355166:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325042304 00000100:00100000:1.0:1788869462.355177:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869462.355230:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325042432 00000100:00100000:3.0:1788869462.355233:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325042432 00000100:00100000:3.0:1788869462.355252:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788869462.355272:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325042304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869462.355303:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869462.355356:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325042304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869462.355363:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788869462.355380:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788869462.355386:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325042432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869462.355397:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869462.360554:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325042432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5156us (5365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869462.360570:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788869462.366132:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869462.366225:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f059500 x1875765325042304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869462.366253:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325042304:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788869462.367547:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703403b80 x1875765325042432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869462.367572:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325042432:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788869463.245820:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869463.379557:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325042560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869463.379648:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869463.381259:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325042560 00000100:00100000:2.0:1788869463.381272:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325042560 00000100:00100000:2.0:1788869463.381340:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788869463.381350:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325042560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869463.381386:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869463.381471:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325042560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869463.381477:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788869463.382200:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325042560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869463.481743:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869463.481787:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869463.481813:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869463.481849:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869463.481918:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305034112 00000100:00100000:1.0:1788869463.481928:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305034112 00000100:00100000:1.0:1788869463.481993:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305034240 00000100:00100000:1.0:1788869463.481997:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305034240 00000100:00100000:1.0:1788869463.482011:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305034496 00000100:00100000:1.0:1788869463.482014:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305034496 00000100:00100000:1.0:1788869463.482032:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:1.0:1788869463.482040:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305034112:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869463.482113:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305034112:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 73us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869463.482134:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:1.0:1788869463.482166:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:1.0:1788869463.482173:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305034240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869463.482201:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305034240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869463.482206:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:1.0:1788869463.482220:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:1.0:1788869463.482226:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305034496:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869463.482262:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305034496:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869463.482267:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00080000:0.0:1788869463.482420:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869463.482425:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869463.482667:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305033984 00000100:00100000:3.0:1788869463.482673:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305033984 00000100:00100000:3.0:1788869463.482705:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 314 00000100:00100000:3.0:1788869463.482713:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305033984:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869463.482747:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305033984:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869463.482753:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 314 00000100:00100000:0.0:1788869463.485799:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869463.485833:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869463.485875:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869463.486028:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305034624 00000100:00100000:1.0:1788869463.486038:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305034624 00000100:00100000:1.0:1788869463.486093:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305034752 00000100:00100000:1.0:1788869463.486096:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305034752 00000100:00100000:1.0:1788869463.486120:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1788869463.486129:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2406:x1875765305034624:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1788869463.486157:0:8443:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce9a7 00000100:00080000:1.0:1788869463.486167:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8e2703412000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869463.486209:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788869463.486360:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc71e56-b348-418d-8d54-3ebb3639d490+2:2406:x1875765305034624:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 231us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869463.486367:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1788869463.486394:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1788869463.486400:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2406:x1875765305034752:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1788869463.486419:0:8443:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce9ae 00000100:00080000:1.0:1788869463.486423:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8e2703415000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869463.486444:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788869463.486500:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc71e56-b348-418d-8d54-3ebb3639d490+2:2406:x1875765305034752:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 100us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869463.486506:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00010000:00010000:1.0:1788869463.486530:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869463.486535:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869463.486541:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869463.486544:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869463.486651:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305034368 00000100:00100000:1.0:1788869463.486656:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305034368 00000100:00100000:1.0:1788869463.486683:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:1.0:1788869463.486689:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305034368:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869463.486720:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305034368:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869463.486727:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00080000:1.0:1788869463.486743:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:1.0:1788869463.699694:0:12612:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869463.700169:0:12612:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869464.268861:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869464.390088:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325042688:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.390184:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.390251:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325043200:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.390283:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.390303:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325043712:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.390328:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.390358:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788869464.390364:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325042816:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.390416:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.390503:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325043328:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.390531:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.390554:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325044224:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.390575:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.390667:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869464.390674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325043840:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.390697:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.390745:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325042688 00000100:00100000:3.0:1788869464.390754:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325042688 00000100:00100000:3.0:1788869464.390803:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788869464.390813:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325042688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.390865:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325042688:12345-0@lo:400:kworker.0 Request processed in 53us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.390873:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788869464.390908:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325042816 00000100:00100000:3.0:1788869464.390912:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325042816 00000100:00100000:3.0:1788869464.390956:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325043328 00000100:00100000:3.0:1788869464.390960:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325043328 00000100:00100000:3.0:1788869464.390984:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325043840 00000100:00100000:3.0:1788869464.390986:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325043840 00000100:00100000:3.0:1788869464.391001:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788869464.391007:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325042816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.391038:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325042816:12345-0@lo:400:kworker.0 Request processed in 31us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.391044:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788869464.391055:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788869464.391061:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325043328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.391089:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325043328:12345-0@lo:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.391095:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788869464.391107:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788869464.391113:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325043840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.391139:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325043840:12345-0@lo:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.391155:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788869464.391179:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325043712 00000100:00100000:3.0:1788869464.391183:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325043712 00000100:00100000:3.0:1788869464.391208:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325044224 00000100:00100000:3.0:1788869464.391211:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325044224 00000100:00100000:3.0:1788869464.391411:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788869464.391418:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325043712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.391453:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325043712:12345-0@lo:400:kworker.0 Request processed in 36us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.391459:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788869464.391470:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869464.391476:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325044224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.391503:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325044224:12345-0@lo:400:kworker.0 Request processed in 28us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.391508:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788869464.391530:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869464.391534:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869464.391537:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869464.391573:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325043840:0@lo:400:kworker.0 00010000:00080000:3.0:1788869464.391612:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111ed80 x1875765325044224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869464.391624:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325044224:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.391635:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325042816:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.391644:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325043328:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.391650:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325042688:0@lo:400:kworker.0 00010000:00080000:3.0:1788869464.391671:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8c380 x1875765325043712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869464.391680:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325043712:0@lo:400:kworker.0 00000100:00100000:2.0:1788869464.393111:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325042944:0@lo:400:kworker.0 00000100:00100000:2.0:1788869464.393177:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869464.393228:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325043456:0@lo:400:kworker.0 00000100:00100000:2.0:1788869464.393254:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869464.393281:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325043968:0@lo:400:kworker.0 00000100:00100000:2.0:1788869464.393303:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869464.393330:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869464.393339:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325043072:0@lo:400:kworker.0 00000100:00100000:2.0:1788869464.393362:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869464.393381:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325043584:0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.393406:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325043456 00000100:00100000:2.0:1788869464.393414:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.393417:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325043456 00000100:00100000:2.0:1788869464.393436:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325044096:0@lo:400:kworker.0 00000100:00100000:2.0:1788869464.393464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.393471:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325043968 00000100:00100000:3.0:1788869464.393476:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325043968 00000100:00100000:3.0:1788869464.393494:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325043072 00000100:00100000:3.0:1788869464.393497:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325043072 00000100:00100000:2.0:1788869464.393508:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325043200 00000100:00100000:2.0:1788869464.393515:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325043200 00000100:00100000:3.0:1788869464.393517:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788869464.393547:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325043456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869464.393552:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325042944 00000100:00100000:2.0:1788869464.393557:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325042944 00000100:00100000:2.0:1788869464.393576:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788869464.393584:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325043200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.393646:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325043456:12345-0@lo:400:kworker.0 Request processed in 101us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.393668:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788869464.393673:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325043200:12345-0@lo:400:kworker.0 Request processed in 89us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869464.393682:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788869464.393688:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788869464.393715:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325043968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.393743:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325043968:12345-0@lo:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.393749:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788869464.393776:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788869464.393781:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325043072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.393808:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325043072:12345-0@lo:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.393813:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1788869464.393830:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869464.394777:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325043584 00000100:00100000:3.0:1788869464.394798:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325043584 00000100:00100000:3.0:1788869464.394847:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325044096 00000100:00100000:3.0:1788869464.394851:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325044096 00000100:00100000:3.0:1788869464.394879:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788869464.394887:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325043584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.394949:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325043584:12345-0@lo:400:kworker.0 Request processed in 63us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.394956:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869464.394997:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788869464.395011:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325042944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869464.395196:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788869464.395203:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325044096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869464.395288:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325042944:12345-0@lo:400:kworker.0 Request processed in 283us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869464.395294:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788869464.395379:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325044096:12345-0@lo:400:kworker.0 Request processed in 176us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.395387:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788869464.395421:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869464.395426:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869464.395480:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325043072:0@lo:400:kworker.0 00010000:00080000:2.0:1788869464.395497:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8df80 x1875765325043584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869464.395507:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325043584:0@lo:400:kworker.0 00010000:00080000:2.0:1788869464.395518:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111d880 x1875765325044096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869464.395527:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325044096:0@lo:400:kworker.0 00000100:00100000:2.0:1788869464.395537:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325042944:0@lo:400:kworker.0 00010000:00080000:2.0:1788869464.395548:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8dc00 x1875765325043456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869464.395556:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325043456:0@lo:400:kworker.0 00010000:00080000:2.0:1788869464.395569:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111f800 x1875765325043968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869464.395577:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325043968:0@lo:400:kworker.0 00000100:00100000:2.0:1788869464.395634:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325043200:0@lo:400:kworker.0 00000100:00100000:0.0:1788869464.902055:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869464.902081:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325044352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869464.902151:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869464.902402:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325044352 00000100:00100000:2.0:1788869464.902411:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325044352 00000100:00100000:2.0:1788869464.902468:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788869464.902479:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325044352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869464.903018:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869464.903138:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325044352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 659us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869464.903146:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788869464.903764:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325044480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869464.903826:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869464.903908:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325044480 00000100:00100000:2.0:1788869464.903914:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325044480 00000100:00100000:2.0:1788869464.903957:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788869464.903966:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325044480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869464.903981:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869464.904017:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325044480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869464.904024:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788869464.904166:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111d880 x1875765325044480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869464.904186:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325044480:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788869464.914326:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111f800 x1875765325044352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869464.914371:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325044352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788869465.289402:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869466.021093:0:12710:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869466.021416:0:12710:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869466.310342:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869466.441190:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325044608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869466.441264:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869466.441564:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325044608 00000100:00100000:2.0:1788869466.441573:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325044608 00000100:00100000:2.0:1788869466.441646:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788869466.441656:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325044608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869466.441687:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869466.441733:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325044608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869466.441740:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788869466.444399:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325044608:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869467.343315:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869467.465698:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325044736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869467.465764:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869467.465830:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325044736 00000100:00100000:2.0:1788869467.465839:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325044736 00000100:00100000:2.0:1788869467.465894:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788869467.465905:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325044736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869467.465934:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869467.465982:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325044736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869467.465995:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1788869467.466017:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869467.466046:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c4a80 x1875765325044736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869467.466063:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325044736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869467.470419:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869467.470442:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325044864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869467.470512:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869467.470570:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325044864 00000100:00100000:2.0:1788869467.470579:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325044864 00000100:00100000:2.0:1788869467.470660:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869467.470669:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325044864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869467.470695:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869467.470750:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325044864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869467.470757:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788869467.470778:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869467.470805:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111ce00 x1875765325044864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869467.470825:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325044864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788869468.358823:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869468.485745:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869468.485771:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325044992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869468.485864:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869468.485938:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325044992 00000100:00100000:3.0:1788869468.485949:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325044992 00000100:00100000:3.0:1788869468.485996:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788869468.486006:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325044992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869468.486047:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869468.486098:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325044992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869468.486106:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788869468.486178:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325044992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869468.610730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869468.610766:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869468.610797:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869468.610813:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869468.610838:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869468.610866:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305035008 00000100:00100000:0.0:1788869468.610875:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305035008 00000100:00100000:0.0:1788869468.610921:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305035264 00000100:00100000:0.0:1788869468.610923:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305035264 00000100:00100000:0.0:1788869468.610935:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305035136 00000100:00100000:0.0:1788869468.610937:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305035136 00000100:00100000:0.0:1788869468.610947:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305035392 00000100:00100000:0.0:1788869468.610949:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305035392 00000100:00100000:0.0:1788869468.610963:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:0.0:1788869468.610971:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305035008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869468.611043:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305035008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 72us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869468.611050:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:0.0:1788869468.611065:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:0.0:1788869468.611070:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305035264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869468.611089:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305035264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 19us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869468.611094:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:0.0:1788869468.611103:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:0.0:1788869468.611108:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305035136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869468.611125:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305035136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 17us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869468.611130:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:0.0:1788869468.611159:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:0.0:1788869468.611165:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305035392:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869468.611186:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305035392:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869468.611192:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00080000:0.0:1788869468.611209:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869468.611213:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869468.611269:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305034880 00000100:00100000:1.0:1788869468.611274:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305034880 00000100:00100000:1.0:1788869468.611309:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 316 00000100:00100000:1.0:1788869468.611316:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305034880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869468.611340:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305034880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869468.611346:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 316 00000020:00000004:0.0:1788869468.733080:0:12807:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869468.733352:0:12807:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:2.0:1788869469.002782:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of acc71e56-b348-418d-8d54-3ebb3639d490 00000020:00000080:2.0:1788869469.002792:0:8435:0:(genops.c:885:class_export_put()) final put ffff8e2703411800/acc71e56-b348-418d-8d54-3ebb3639d490 00000020:00000080:0.0:1788869469.002849:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703411800/acc71e56-b348-418d-8d54-3ebb3639d490 for lustre-OST0000 00000020:00000080:0.0:1788869469.002963:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2703412000 for lustre-OST0000 00000001:00100000:3.0:1788869469.004576:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of acc71e56-b348-418d-8d54-3ebb3639d490 00000020:00000080:3.0:1788869469.004608:0:9520:0:(genops.c:885:class_export_put()) final put ffff8e2703414000/acc71e56-b348-418d-8d54-3ebb3639d490 00000020:00000080:0.0:1788869469.005983:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703414000/acc71e56-b348-418d-8d54-3ebb3639d490 for lustre-OST0001 00000020:00000080:0.0:1788869469.006057:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2703415000 for lustre-OST0001 00010000:00010000:2.0:1788869469.384891:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869469.509911:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325045504:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.509986:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510066:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325046016:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510095:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510116:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325046528:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510146:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510168:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788869469.510174:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325045120:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510199:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510218:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325045632:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510241:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510256:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325046144:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510277:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510291:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325046656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510309:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510330:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325045248:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510350:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510363:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325045760:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510379:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510394:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325046272:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510411:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510426:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788869469.510431:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325045376:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510449:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510462:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325045888:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510479:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510497:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325046400:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510514:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869469.510536:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325046016 00000100:00100000:2.0:1788869469.510543:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325046016 00000100:00100000:2.0:1788869469.510607:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325046528 00000100:00100000:2.0:1788869469.510611:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325046528 00000100:00100000:2.0:1788869469.510624:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325046144 00000100:00100000:2.0:1788869469.510626:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325046144 00000100:00100000:2.0:1788869469.510642:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325046656 00000100:00100000:2.0:1788869469.510644:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325046656 00000100:00100000:2.0:1788869469.510658:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788869469.510666:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325046016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510721:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325046016:12345-0@lo:400:kworker.0 Request processed in 55us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.510728:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788869469.510746:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788869469.510752:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325046528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510779:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325046528:12345-0@lo:400:kworker.0 Request processed in 27us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.510785:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788869469.510795:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869469.510800:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325046144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510826:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325046144:12345-0@lo:400:kworker.0 Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.510832:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869469.510842:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869469.510847:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325046656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.510879:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325046656:12345-0@lo:400:kworker.0 Request processed in 32us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.510885:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869469.510919:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325045504 00000100:00100000:2.0:1788869469.510922:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325045504 00000100:00100000:2.0:1788869469.510939:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325045248 00000100:00100000:2.0:1788869469.510941:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325045248 00000100:00100000:2.0:1788869469.510949:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325045760 00000100:00100000:2.0:1788869469.510951:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325045760 00000100:00100000:2.0:1788869469.510962:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325046272 00000100:00100000:2.0:1788869469.510964:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325046272 00000100:00100000:2.0:1788869469.510974:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325045888 00000100:00100000:2.0:1788869469.510976:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325045888 00000100:00100000:2.0:1788869469.510985:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325046400 00000100:00100000:2.0:1788869469.510987:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325046400 00000100:00100000:2.0:1788869469.510998:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788869469.511004:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325045504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511032:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325045504:12345-0@lo:400:kworker.0 Request processed in 28us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.511038:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788869469.511051:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788869469.511056:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325045248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511082:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325045248:12345-0@lo:400:kworker.0 Request processed in 27us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.511087:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788869469.511098:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788869469.511103:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325045760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511138:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325045760:12345-0@lo:400:kworker.0 Request processed in 35us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.511150:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788869469.511163:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788869469.511169:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325046272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511198:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325046272:12345-0@lo:400:kworker.0 Request processed in 30us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.511204:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788869469.511218:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788869469.511223:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325045888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511247:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325045888:12345-0@lo:400:kworker.0 Request processed in 25us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.511252:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788869469.511263:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788869469.511269:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325046400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511295:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325046400:12345-0@lo:400:kworker.0 Request processed in 26us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869469.511301:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00080000:2.0:1788869469.511341:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111f800 x1875765325045888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869469.511354:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325045888:0@lo:400:kworker.0 00010000:00080000:2.0:1788869469.511366:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044e00 x1875765325046400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869469.511375:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325046400:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511385:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325045248:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511405:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325045760:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511413:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325046272:0@lo:400:kworker.0 00010000:00080000:2.0:1788869469.511448:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111ed80 x1875765325046144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869469.511458:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325046144:0@lo:400:kworker.0 00010000:00080000:2.0:1788869469.511469:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f045c00 x1875765325046656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869469.511476:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325046656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.511485:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325045504:0@lo:400:kworker.0 00010000:00080000:2.0:1788869469.511494:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111d880 x1875765325046016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869469.511501:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325046016:0@lo:400:kworker.0 00010000:00080000:2.0:1788869469.511511:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044380 x1875765325046528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869469.511519:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325046528:0@lo:400:kworker.0 00000100:00080000:0.0:1788869469.513047:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869469.513053:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869469.513057:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869469.513059:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869469.513658:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325045120 00000100:00100000:3.0:1788869469.513670:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325045120 00000100:00100000:3.0:1788869469.513757:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788869469.513766:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325045120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869469.513863:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325045120:12345-0@lo:400:kworker.0 Request processed in 99us (3662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869469.513871:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788869469.513906:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325045632 00000100:00100000:3.0:1788869469.513910:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325045632 00000100:00100000:3.0:1788869469.513935:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325045376 00000100:00100000:3.0:1788869469.513939:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325045376 00000100:00100000:3.0:1788869469.513953:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788869469.513959:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325045632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869469.513995:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325045632:12345-0@lo:400:kworker.0 Request processed in 36us (3753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869469.514014:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788869469.514027:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788869469.514043:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869469.514083:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325045376:12345-0@lo:400:kworker.0 Request processed in 50us (3632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869469.514089:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788869469.514157:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325045376:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.515009:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325045120:0@lo:400:kworker.0 00000100:00100000:2.0:1788869469.515024:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325045632:0@lo:400:kworker.0 00000100:00100000:1.0:1788869470.023235:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869470.023259:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325046784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869470.023334:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869470.023408:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325046784 00000100:00100000:1.0:1788869470.023418:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325046784 00000100:00100000:1.0:1788869470.023469:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788869470.023479:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325046784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869470.023510:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869470.023562:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325046784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869470.023569:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1788869470.023646:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db35500 x1875765325046784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869470.023664:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325046784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869470.034554:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869470.034578:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325046912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869470.034669:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869470.034744:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325046912 00000100:00100000:2.0:1788869470.034754:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325046912 00000100:00100000:2.0:1788869470.034805:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788869470.034815:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325046912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869470.034837:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869470.034883:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325046912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869470.034890:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788869470.034944:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27038e8380 x1875765325046912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869470.034962:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325046912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788869470.406659:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869471.365623:0:12904:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869471.365842:0:12904:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869471.430006:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869471.564556:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869471.564579:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325047040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869471.564665:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869471.564726:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325047040 00000100:00100000:2.0:1788869471.564735:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325047040 00000100:00100000:2.0:1788869471.564792:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788869471.564800:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325047040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869471.564836:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869471.564882:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325047040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869471.564888:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788869471.564933:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325047040:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869472.455151:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869472.581940:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325047168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869472.582012:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869472.582187:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325047168 00000100:00100000:1.0:1788869472.582194:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325047168 00000100:00100000:1.0:1788869472.582244:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869472.582258:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325047168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869472.582285:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788869472.582411:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869472.582421:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325047296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869472.582450:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869472.582487:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325047296 00000100:00100000:0.0:1788869472.582492:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325047296 00000100:00100000:0.0:1788869472.582517:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788869472.582523:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325047296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869472.582534:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869472.582572:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325047296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869472.582579:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788869472.582617:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869472.582647:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c6300 x1875765325047296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869472.582667:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325047296:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788869472.582827:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db35500 x1875765325047168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869472.582827:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325047168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 569us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869472.582834:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788869472.582841:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325047168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788869473.477711:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869473.606757:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869473.606784:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325047424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869473.606853:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869473.606926:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325047424 00000100:00100000:3.0:1788869473.606935:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325047424 00000100:00100000:3.0:1788869473.606986:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788869473.606995:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325047424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869473.607032:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869473.607099:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325047424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869473.607106:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788869473.607121:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325047424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869473.750380:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869473.751151:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305035520 00000100:00100000:0.0:1788869473.751164:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305035520 00000100:00100000:0.0:1788869473.751239:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 318 00000100:00100000:0.0:1788869473.751253:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305035520:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869473.751337:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305035520:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 87us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869473.751345:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 318 00000100:00100000:1.0:1788869473.751546:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869473.752544:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305035776 00000100:00100000:2.0:1788869473.752563:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305035776 00000100:00100000:2.0:1788869473.752711:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:2.0:1788869473.752724:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305035776:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869473.752834:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305035776:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 112us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869473.752844:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00080000:2.0:1788869473.752872:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869473.757163:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869473.757233:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869473.757258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869473.757304:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305036032 00000100:00100000:0.0:1788869473.757313:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305036032 00000100:00100000:0.0:1788869473.757372:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305035648 00000100:00100000:0.0:1788869473.757375:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305035648 00000100:00100000:0.0:1788869473.757391:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305035904 00000100:00100000:0.0:1788869473.757392:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305035904 00000100:00100000:2.0:1788869473.757427:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:2.0:1788869473.757454:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305036032:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869473.757631:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305036032:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 188us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869473.759923:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:0.0:1788869473.759953:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305035648:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869473.760069:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305035648:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 132us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869473.760093:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:0.0:1788869473.760137:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:0.0:1788869473.760145:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305035904:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869473.760175:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305035904:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (2916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869473.760182:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00080000:0.0:1788869473.760211:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869473.760217:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869473.769933:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 205 00010000:00010000:1.0:1788869474.503420:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869474.638832:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325047680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.638883:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325047808:0@lo:400:kworker.0 00000100:00100000:0.0:1788869474.638962:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325047552:0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.639085:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325047936:0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.646954:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869474.647083:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325048448:0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.647132:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869474.647165:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325048960:0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.647186:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869474.647221:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788869474.647230:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325048320:0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.647234:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869474.647268:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869474.647289:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325048832:0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.647305:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325048448 00000100:00100000:1.0:1788869474.647310:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869474.647316:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325048448 00000100:00100000:1.0:1788869474.647340:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325047936 00000100:00100000:1.0:1788869474.647344:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325047936 00000100:00100000:3.0:1788869474.647383:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325048960 00000100:00100000:1.0:1788869474.647383:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325048320 00000100:00100000:3.0:1788869474.647385:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325048960 00000100:00100000:1.0:1788869474.647385:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325048320 00000100:00100000:1.0:1788869474.647400:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325048832 00000100:00100000:1.0:1788869474.647402:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325048832 00000100:00100000:3.0:1788869474.647407:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869474.647417:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325048448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.647418:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788869474.647423:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325047936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.647487:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325048448:12345-0@lo:400:kworker.0 Request processed in 72us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869474.647510:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869474.647529:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869474.647535:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.647569:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325048960:12345-0@lo:400:kworker.0 Request processed in 34us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869474.647759:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869474.647786:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325047808 00000100:00100000:3.0:1788869474.647790:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325047808 00000100:00100000:3.0:1788869474.647819:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788869474.647826:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325047808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.647869:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325047808:12345-0@lo:400:kworker.0 Request processed in 44us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869474.647875:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788869474.647895:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788869474.647902:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325048320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.647931:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325048320:12345-0@lo:400:kworker.0 Request processed in 30us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869474.647936:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788869474.647972:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788869474.647977:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325048832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.647998:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325048832:12345-0@lo:400:kworker.0 Request processed in 21us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869474.648003:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:3.0:1788869474.648019:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869474.648035:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869474.648046:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869474.648096:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325047808:0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.648380:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325047936:12345-0@lo:400:kworker.0 Request processed in 955us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869474.648387:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00010000:00080000:1.0:1788869474.648425:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040abb80 x1875765325048320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869474.648699:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869474.648742:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325047552 00000100:00100000:3.0:1788869474.648748:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325047552 00000100:00100000:0.0:1788869474.648754:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325048064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.648788:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788869474.648796:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325047552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.648833:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325047552:12345-0@lo:400:kworker.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869474.648840:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788869474.649053:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869474.649093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325048576:0@lo:400:kworker.0 00000100:00100000:0.0:1788869474.649131:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869474.649158:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325048576 00000100:00100000:0.0:1788869474.649162:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325048576 00000100:00100000:0.0:1788869474.649205:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788869474.649212:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325048576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869474.649260:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325048576:12345-0@lo:400:kworker.0 Request processed in 48us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869474.649267:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788869474.649286:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869474.649311:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040ab480 x1875765325048576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869474.649325:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325048576:0@lo:400:kworker.0 00000100:00100000:0.0:1788869474.649345:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325049088:0@lo:400:kworker.0 00000100:00100000:0.0:1788869474.649376:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869474.649399:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325049088 00000100:00100000:0.0:1788869474.649403:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325049088 00000100:00100000:1.0:1788869474.649988:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325048320:0@lo:400:kworker.0 00010000:00080000:1.0:1788869474.650018:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040aa680 x1875765325048832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869474.650041:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325048832:0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.650058:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325047936:0@lo:400:kworker.0 00010000:00080000:1.0:1788869474.650075:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a9180 x1875765325048448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869474.650085:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325048448:0@lo:400:kworker.0 00010000:00080000:1.0:1788869474.650101:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a8a80 x1875765325048960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869474.650109:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325048960:0@lo:400:kworker.0 00000100:00080000:1.0:1788869474.650181:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869474.650203:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325047552:0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.650209:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325048064 00000100:00100000:3.0:1788869474.650213:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325048064 00000100:00100000:1.0:1788869474.650231:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788869474.650239:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325048192:0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.650246:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788869474.650253:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325048064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.650293:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869474.650298:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325048064:12345-0@lo:400:kworker.0 Request processed in 46us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869474.650305:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788869474.650315:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325048704:0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.650327:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325048192 00000100:00100000:3.0:1788869474.650330:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325048192 00000100:00100000:1.0:1788869474.650349:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869474.650399:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788869474.650409:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325049088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788869474.650988:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869474.651397:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325049088:12345-0@lo:400:kworker.0 Request processed in 985us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869474.651409:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1788869474.653916:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2817952a00 x1875765325049088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869474.653938:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325049088:0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.653954:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325048064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.657611:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325048704 00000100:00100000:3.0:1788869474.657634:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325048704 00000100:00100000:2.0:1788869474.657662:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788869474.657755:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325048192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869474.658062:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325048192:12345-0@lo:400:kworker.0 Request processed in 386us (7767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869474.658071:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788869474.658116:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869474.658176:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325047680 00000100:00100000:2.0:1788869474.658181:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325047680 00000100:00100000:2.0:1788869474.658222:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788869474.658229:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325047680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869474.658267:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325047680:12345-0@lo:400:kworker.0 Request processed in 39us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869474.658274:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788869474.658328:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325047680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.659278:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788869474.659289:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325048704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869474.659364:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325048704:12345-0@lo:400:kworker.0 Request processed in 76us (9013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869474.659370:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:2.0:1788869474.660647:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869474.660948:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325048192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869474.660973:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325048704:0@lo:400:kworker.0 00000100:00100000:0.0:1788869475.142262:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869475.142287:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325049216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869475.142382:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869475.142464:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325049216 00000100:00100000:0.0:1788869475.142472:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325049216 00000100:00100000:0.0:1788869475.142528:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788869475.142538:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325049216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869475.142575:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869475.143200:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325049344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869475.143240:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869475.143291:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325049344 00000100:00100000:3.0:1788869475.143296:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325049344 00000100:00100000:3.0:1788869475.143316:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869475.143322:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325049344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869475.143336:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869475.143621:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325049216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1084us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.143628:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788869475.144481:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325049344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1155us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869475.144491:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1788869475.144544:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31880 x1875765325049344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869475.144570:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325049344:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788869475.144731:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f0000 x1875765325049216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869475.144745:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325049216:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788869475.526291:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869475.989195:0:13049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788869476.549835:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869476.680324:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325049472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869476.680797:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869476.681031:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325049472 00000100:00100000:3.0:1788869476.681050:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325049472 00000100:00100000:3.0:1788869476.681109:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788869476.681120:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325049472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869476.681158:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869476.681209:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325049472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869476.681235:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788869476.681572:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325049472:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869477.573946:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869477.705492:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869477.705527:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325049600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869477.705645:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869477.705746:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325049600 00000100:00100000:3.0:1788869477.705759:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325049600 00000100:00100000:3.0:1788869477.705852:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788869477.705864:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325049600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869477.705915:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869477.705988:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325049600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869477.706015:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788869477.706043:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869477.706086:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31180 x1875765325049600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869477.706114:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325049600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869477.710971:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325049728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869477.711104:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869477.711205:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325049728 00000100:00100000:3.0:1788869477.711217:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325049728 00000100:00100000:3.0:1788869477.711300:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788869477.711313:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325049728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869477.711351:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869477.711404:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325049728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869477.711412:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788869477.711439:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869477.711475:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31180 x1875765325049728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869477.711500:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325049728:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788869478.616518:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869478.726740:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869478.726769:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325049856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869478.726847:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869478.727796:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325049856 00000100:00100000:0.0:1788869478.727813:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325049856 00000100:00100000:0.0:1788869478.727979:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788869478.727992:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325049856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869478.728042:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869478.728119:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325049856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869478.728127:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788869478.728930:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325049856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869478.842241:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869478.842415:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305036160 00000100:00100000:3.0:1788869478.842427:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305036160 00000100:00100000:3.0:1788869478.842488:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 320 00000100:00100000:3.0:1788869478.842498:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305036160:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869478.842612:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305036160:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 115us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869478.842634:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 320 00000100:00100000:3.0:1788869478.847557:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869478.847625:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869478.847649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869478.847677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869478.847705:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305036288 00000100:00100000:3.0:1788869478.847714:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305036288 00000100:00100000:3.0:1788869478.847765:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305036544 00000100:00100000:3.0:1788869478.847768:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305036544 00000100:00100000:3.0:1788869478.847782:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305036416 00000100:00100000:3.0:1788869478.847784:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305036416 00000100:00100000:3.0:1788869478.847796:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305036672 00000100:00100000:3.0:1788869478.847799:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305036672 00000100:00100000:3.0:1788869478.847816:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:3.0:1788869478.847825:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305036288:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869478.847900:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305036288:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 76us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869478.847908:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:3.0:1788869478.847924:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:3.0:1788869478.847930:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305036544:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869478.847966:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305036544:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869478.847973:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:3.0:1788869478.847985:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:3.0:1788869478.847991:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305036416:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869478.848018:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305036416:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869478.848038:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:3.0:1788869478.848052:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:3.0:1788869478.848058:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305036672:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869478.848081:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305036672:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869478.848086:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00080000:3.0:1788869478.848106:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869478.848110:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788869479.622680:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869479.751597:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325050368:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.751684:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.751750:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325050880:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.751777:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.751795:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325051392:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.751815:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.751836:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788869479.751852:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325049984:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.751883:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.751904:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325050496:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.751938:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.751954:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325051008:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.751974:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.751989:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325051520:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752009:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.752036:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325050112:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752060:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.752075:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325050624:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752095:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.752114:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325051136:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752133:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.752152:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869479.752158:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325050240:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752194:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.752213:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325050752:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752234:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.752243:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325051264:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752260:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869479.752282:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325050368 00000100:00100000:2.0:1788869479.752291:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325050368 00000100:00100000:2.0:1788869479.752326:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325050112 00000100:00100000:2.0:1788869479.752328:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325050112 00000100:00100000:2.0:1788869479.752345:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325050624 00000100:00100000:2.0:1788869479.752348:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325050624 00000100:00100000:2.0:1788869479.752366:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325051136 00000100:00100000:2.0:1788869479.752369:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325051136 00000100:00100000:2.0:1788869479.752381:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325050752 00000100:00100000:2.0:1788869479.752384:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325050752 00000100:00100000:2.0:1788869479.752394:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325051264 00000100:00100000:2.0:1788869479.752397:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325051264 00000100:00100000:2.0:1788869479.752414:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788869479.752422:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325050368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752474:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325050368:12345-0@lo:400:kworker.0 Request processed in 52us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869479.752481:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788869479.752497:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788869479.752502:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325050112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752534:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325050112:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869479.752540:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788869479.752552:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788869479.752557:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325050624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752583:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325050624:12345-0@lo:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869479.752609:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788869479.752621:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788869479.752627:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325051136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752653:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325051136:12345-0@lo:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869479.752668:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788869479.752680:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788869479.752685:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325050752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752721:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325050752:12345-0@lo:400:kworker.0 Request processed in 35us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869479.752727:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788869479.752739:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788869479.752745:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325051264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752773:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325051264:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869479.752779:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788869479.752793:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325050880 00000100:00100000:3.0:1788869479.752800:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325050880 00010000:00080000:2.0:1788869479.752827:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111ed80 x1875765325050752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869479.752837:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325051392 00000100:00100000:3.0:1788869479.752842:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325051392 00000100:00100000:2.0:1788869479.752848:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325050752:0@lo:400:kworker.0 00000100:00100000:3.0:1788869479.752861:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325051008 00000100:00100000:3.0:1788869479.752865:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325051008 00010000:00080000:2.0:1788869479.752866:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a8f800 x1875765325051264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869479.752877:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325051264:0@lo:400:kworker.0 00000100:00100000:3.0:1788869479.752886:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325051520 00000100:00100000:3.0:1788869479.752891:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325051520 00000100:00100000:2.0:1788869479.752893:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325050112:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752905:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325050624:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752913:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325051136:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752959:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325050368:0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.752998:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325049984 00000100:00100000:2.0:1788869479.753007:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325049984 00000100:00100000:2.0:1788869479.753034:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788869479.753042:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325049984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.753082:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325049984:12345-0@lo:400:kworker.0 Request processed in 42us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869479.753088:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788869479.753120:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325049984:0@lo:400:kworker.0 00000100:00080000:2.0:1788869479.753147:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869479.753152:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869479.753154:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869479.753157:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869479.753172:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788869479.753172:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325050496 00000100:00100000:2.0:1788869479.753178:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325050496 00000100:00100000:3.0:1788869479.753186:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325050880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.753206:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325050240 00000100:00100000:2.0:1788869479.753210:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325050240 00000100:00100000:2.0:1788869479.753227:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788869479.753236:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325050496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869479.753243:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325050880:12345-0@lo:400:kworker.0 Request processed in 60us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869479.753251:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869479.753267:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869479.753280:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325050496:12345-0@lo:400:kworker.0 Request processed in 45us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869479.753287:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788869479.753300:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788869479.753306:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325050240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.753337:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325050240:12345-0@lo:400:kworker.0 Request processed in 31us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869479.753343:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788869479.753368:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325050240:0@lo:400:kworker.0 00000100:00100000:3.0:1788869479.753391:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325051392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.753407:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325050496:0@lo:400:kworker.0 00010000:00080000:2.0:1788869479.753432:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111ca80 x1875765325050880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869479.753436:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325051392:12345-0@lo:400:kworker.0 Request processed in 160us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869479.753450:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869479.753455:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325050880:0@lo:400:kworker.0 00010000:00080000:2.0:1788869479.753477:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a8fb80 x1875765325051392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869479.753478:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788869479.753488:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325051008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869479.753494:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325051392:0@lo:400:kworker.0 00000100:00100000:3.0:1788869479.753531:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325051008:12345-0@lo:400:kworker.0 Request processed in 44us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869479.753538:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1788869479.753545:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111c000 x1875765325051008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869479.753553:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788869479.753561:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325051008:0@lo:400:kworker.0 00000100:00100000:3.0:1788869479.753565:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325051520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869479.753634:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325051520:12345-0@lo:400:kworker.0 Request processed in 72us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869479.753641:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1788869479.753664:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a8f480 x1875765325051520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869479.753674:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325051520:0@lo:400:kworker.0 00000100:00100000:1.0:1788869480.262097:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869480.262128:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325051648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869480.262219:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869480.262299:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325051648 00000100:00100000:1.0:1788869480.262307:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325051648 00000100:00100000:1.0:1788869480.262358:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788869480.262367:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325051648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869480.262415:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869480.262472:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325051648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869480.262490:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1788869480.262550:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a9c00 x1875765325051648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869480.262570:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325051648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869480.272675:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869480.272711:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325051776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869480.272797:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869480.272982:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325051776 00000100:00100000:0.0:1788869480.272993:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325051776 00000100:00100000:0.0:1788869480.273067:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869480.273079:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325051776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869480.273105:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869480.273154:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325051776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869480.273161:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1788869480.273324:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db35500 x1875765325051776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869480.273349:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325051776:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788869480.639857:0:13197:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc939b7860 20000000:00000080:2.0:1788869480.639878:0:13197:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2703909c00 uarg=0000000000000000 20000000:01000000:2.0:1788869480.640266:0:13197:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788869480.640273:0:13197:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788869480.640278:0:13197:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788869480.643245:0:13198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 00010000:00010000:3.0:1788869480.646732:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:00000400:2.0:1788869480.653707:0:13197:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788869480.663709:0:13197:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788869480.670051:0:13197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670087:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cae expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670098:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce94c expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670104:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce95a expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670111:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce968 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670140:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce976 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670147:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ced expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670156:0:13197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670208:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ced expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670229:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ced expref: 12 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869480.670246:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325051904:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869480.670374:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce976 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670383:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce976 expref: 23 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869480.670392:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052032:0@lo:104: 00000100:00100000:0.0:1788869480.670434:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869480.670474:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce968 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.670482:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce968 expref: 23 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869480.671139:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325052032 00000100:00100000:3.0:1788869480.671149:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325052032 00000100:00100000:3.0:1788869480.671212:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869480.671223:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:13197:x1875765325052032:12345-0@lo:104: 00010000:00010000:3.0:1788869480.671237:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.671303:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869480.671309:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:13197:x1875765325052032:12345-0@lo:104: Request processed in 89us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869480.671316:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788869480.671395:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869480.671403:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.671410:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869480.671415:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.671424:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869480.671432:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869480.671437:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869480.671476:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.671483:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869480.671517:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.671525:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6ce976 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce97d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.671540:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869480.671542:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869480.671544:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869480.671612:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325052288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869480.671652:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869480.672278:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325052288 00000100:00100000:2.0:1788869480.672305:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325052288 00010000:00010000:2.0:1788869480.672331:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce976 expref: 24 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869480.672373:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869480.672381:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325052288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869480.672393:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869480.672399:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce976 expref: 24 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869480.674048:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052160:0@lo:104: 00000100:00100000:0.0:1788869480.674260:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869480.674530:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325052160 00000100:00100000:3.0:1788869480.674541:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325052160 00000100:00100000:3.0:1788869480.674614:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788869480.674624:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:13197:x1875765325052160:12345-0@lo:104: 00010000:00010000:3.0:1788869480.674643:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.674710:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869480.674715:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:13197:x1875765325052160:12345-0@lo:104: Request processed in 94us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869480.674722:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788869480.674747:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869480.674754:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.674761:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe1200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869480.674764:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.674773:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869480.674780:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869480.674787:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869480.674824:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.674831:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869480.674852:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.674859:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ce968 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce96f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.674885:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869480.674887:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869480.674888:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869480.674924:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325052416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869480.674960:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869480.675014:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325052416 00000100:00100000:3.0:1788869480.675018:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325052416 00010000:00010000:3.0:1788869480.675037:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce968 expref: 25 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869480.675060:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869480.675066:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+25:3651:x1875765325052416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869480.675077:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869480.675082:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce968 expref: 25 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.677209:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce976 expref: 25 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.677249:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869480.677335:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+25:3650:x1875765325052288:12345-0@lo:103:ldlm_bl.0 Request processed in 4954us (5681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869480.677345:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869480.680517:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325052288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869480.680837:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce95a expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.680857:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce95a expref: 24 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869480.680876:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052544:0@lo:104: 00000100:00100000:0.0:1788869480.680944:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869480.681086:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce94c expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.681096:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce94c expref: 24 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869480.681104:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b472680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052672:0@lo:104: 00000100:00100000:0.0:1788869480.681215:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869480.681250:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cae expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.681260:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cae expref: 12 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869480.681271:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052800:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869480.681331:0:13197:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27028aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869480.681352:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325051904:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869480.681387:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe0800/0x4c16c38a9b6ce97d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce976 expref: 24 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869480.681404:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052032:0@lo:104: 00000100:00100000:0.0:1788869480.681414:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052160:0@lo:104: 00000100:00100000:2.0:1788869480.681557:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325052544 00000100:00100000:2.0:1788869480.681578:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325052544 00000100:00100000:2.0:1788869480.681657:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325052672 00000100:00100000:2.0:1788869480.681661:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325052672 00000100:00100000:2.0:1788869480.681677:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869480.681687:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:13197:x1875765325052544:12345-0@lo:104: 00010000:00010000:2.0:1788869480.681700:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.681765:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869480.681772:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:13197:x1875765325052544:12345-0@lo:104: Request processed in 86us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869480.681779:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869480.681809:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869480.681814:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:13197:x1875765325052672:12345-0@lo:104: 00010000:00010000:2.0:1788869480.681822:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.681877:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869480.681882:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:13197:x1875765325052672:12345-0@lo:104: Request processed in 68us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869480.681888:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869480.683377:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052544:0@lo:104: 00000100:00100000:0.0:1788869480.683394:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b472680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052672:0@lo:104: 00010000:00010000:2.0:1788869480.684617:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869480.684632:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684644:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe0400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869480.684648:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684660:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869480.684668:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869480.684674:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869480.684734:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684742:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869480.684768:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684794:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0400/0x4c16c38a9b6ce95a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce961 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684812:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869480.684816:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684821:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda800 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869480.684824:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684831:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869480.684837:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869480.684842:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869480.684853:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684859:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869480.684864:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684871:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6ce94c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce953 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.684885:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869480.684890:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869480.684892:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869480.685103:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce968 expref: 23 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.685119:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce96f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce968 expref: 23 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.685132:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869480.685260:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1788869480.685329:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869480.685386:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3651:x1875765325052416:12345-0@lo:103:ldlm_bl.0 Request processed in 10318us (10424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869480.685397:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869480.685446:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325052416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869480.685492:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305036800 00000100:00100000:3.0:1788869480.685499:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305036800 00010000:00010000:3.0:1788869480.685524:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ced expref: 13 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869480.685552:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788869480.685560:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305036800:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869480.685571:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869480.685576:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ced expref: 13 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.685609:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ced expref: 13 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.685621:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce992 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ced expref: 13 pid: 6516 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.685629:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869480.685661:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:448e652b-ca43-4915-9c32-5166fb543df5+12:2410:x1875765305036800:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 103us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869480.685667:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1788869480.688513:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325052928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869480.688663:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869480.688748:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869480.688755:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325053056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869480.688777:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869480.688832:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325052928 00000100:00100000:1.0:1788869480.688843:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325052928 00010000:00010000:1.0:1788869480.688888:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce95a expref: 22 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869480.688926:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325053056 00000100:00100000:1.0:1788869480.688930:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325053056 00010000:00010000:1.0:1788869480.688942:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce94c expref: 23 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869480.688957:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869480.688966:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:3648:x1875765325052928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869480.688981:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869480.689017:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce95a expref: 23 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869480.689029:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce95a expref: 23 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869480.689048:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe1400/0x4c16c38a9b6ce961 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce95a expref: 23 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869480.689065:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869480.689107:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3648:x1875765325052928:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869480.689297:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869480.689309:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3648:x1875765325053056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869480.689319:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869480.689325:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce94c expref: 22 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.689336:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce94c expref: 22 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.689348:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6ce953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce94c expref: 22 pid: 6518 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.689358:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869480.689386:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3648:x1875765325053056:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869480.689394:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869480.689564:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869480.689641:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325053056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869480.689652:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325052928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869480.690900:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869480.691330:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875765325052800:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869480.691373:0:13197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869480.698678:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305036928 00000100:00100000:2.0:1788869480.698696:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305036928 00010000:00010000:3.0:1788869480.698962:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cae expref: 12 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869480.699018:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788869480.699029:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:448e652b-ca43-4915-9c32-5166fb543df5+12:2409:x1875765305036928:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869480.699046:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869480.699067:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cae expref: 12 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699081:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cae expref: 12 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699101:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6ce945 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cae expref: 12 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699117:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699124:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699143:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699150:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699157:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699163:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699169:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869480.699174:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699184:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699201:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869480.699212:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869480.699291:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:448e652b-ca43-4915-9c32-5166fb543df5+11:2409:x1875765305036928:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 263us (8398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869480.699298:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00010000:00010000:0.0:1788869480.699512:0:13197:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.699521:0:13197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.699527:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6ce9b5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869481.678361:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869481.799138:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:01000000:0.0:1788869481.800911:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869481.800919:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e27029d7800 from 7 10000000:01000000:0.0:1788869481.800924:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869481.800970:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.800982:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.800994:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869481.801034:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869481.801110:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869481.801183:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27028aec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869481.804390:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325053184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869481.804441:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325053312 00000100:00100000:1.0:1788869481.804450:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325053312 00000100:00100000:3.0:1788869481.804467:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869481.804497:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788869481.804505:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765325053312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869481.804521:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869481.804541:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce9bc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.804568:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9bc expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.804580:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9bc expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.804629:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ea00, rc 0) 00000100:00100000:1.0:1788869481.804677:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325053312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869481.804693:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788869481.804728:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869481.804746:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.804756:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869481.804821:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325053184 00000100:00100000:2.0:1788869481.804826:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325053184 00000100:00100000:0.0:1788869481.804831:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869481.804867:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788869481.804870:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869481.804874:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325053184:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869481.804911:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27028aec00 going to sleep for 11 seconds 00000004:00000024:2.0:1788869481.804913:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869481.804939:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325053440 00000100:00100000:0.0:1788869481.804942:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325053440 00000100:00100000:2.0:1788869481.804954:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325053184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869481.804960:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788869481.804962:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788869481.805118:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325053184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869481.805152:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325053440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869481.805276:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325053440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869481.805283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788869481.805405:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869481.805435:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869481.805473:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869481.805494:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869481.805548:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325053568 00000100:00100000:1.0:1788869481.805556:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325053568 00000100:00100000:1.0:1788869481.805625:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788869481.805633:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325053568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869481.805968:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325053568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 336us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869481.805976:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788869481.806083:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788869481.807009:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788869481.808406:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788869481.808448:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869481.808462:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.808478:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869481.808513:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869481.808517:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e283b46c800 from 7 10000000:01000000:0.0:1788869481.808520:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869481.808571:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.808579:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.808630:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869481.808661:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b472680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869481.808742:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869481.808785:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27028ae780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869481.809300:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325053696 00000100:00100000:3.0:1788869481.809310:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325053696 00000100:00100000:3.0:1788869481.809374:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788869481.809384:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325053696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869481.809398:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869481.809413:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce9ca expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869481.809446:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9ca expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869481.809457:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9ca expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869481.809466:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe0000, rc 0) 00000100:00100000:3.0:1788869481.809517:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325053696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869481.809525:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788869481.810263:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b472680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869481.810284:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.810293:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869481.810366:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869481.810401:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869481.810438:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869481.810499:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325053824 00000100:00100000:2.0:1788869481.810514:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325053824 00000100:00100000:2.0:1788869481.810552:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788869481.810560:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325053824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869481.810733:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325053824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869481.810740:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788869481.811054:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869481.811085:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869481.811125:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869481.811150:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869481.811261:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325053952 00000100:00100000:2.0:1788869481.811266:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325053952 00000100:00100000:2.0:1788869481.811303:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788869481.811310:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325053952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869481.811413:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325053952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869481.811420:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788869481.811508:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325053952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788869481.812936:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788869481.815435:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788869481.815492:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869481.815504:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.815518:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869481.815530:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869481.815532:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282daf5000 from 7 10000000:01000000:0.0:1788869481.815535:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869481.815581:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.815630:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.815641:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869481.815669:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869481.815761:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869481.815809:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27028ae300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869481.816258:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325054080 00000100:00100000:1.0:1788869481.816267:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325054080 00000100:00100000:1.0:1788869481.816311:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788869481.816320:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325054080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869481.816335:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869481.816348:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce9d8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.816372:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9d8 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.816382:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9d8 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.816389:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f200, rc 0) 00000100:00100000:1.0:1788869481.816429:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325054080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869481.816435:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788869481.817292:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869481.817312:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.817323:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869481.817392:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869481.817431:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869481.817476:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27028ae300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869481.817530:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325054208 00000100:00100000:1.0:1788869481.817535:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325054208 00000100:00100000:1.0:1788869481.817573:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788869481.817581:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325054208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869481.817746:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325054208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869481.817753:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788869481.818207:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869481.818241:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869481.818295:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869481.818331:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27028ae300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869481.822377:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325054336 00000100:00100000:2.0:1788869481.822396:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325054336 00000100:00100000:2.0:1788869481.822481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788869481.822493:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325054336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869481.822728:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325054336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (4430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869481.822736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788869481.823768:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869481.827460:0:13212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788869481.827980:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788869481.828005:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869481.828026:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.828039:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869481.828051:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869481.828053:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e281757b800 from 7 10000000:01000000:1.0:1788869481.828056:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869481.828101:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.828109:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869481.828121:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869481.828147:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869481.828220:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869481.828258:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2801254780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869481.828877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325054464 00000100:00100000:2.0:1788869481.828898:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325054464 00000100:00100000:2.0:1788869481.828953:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788869481.828964:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325054464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869481.828989:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869481.829004:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ce9e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869481.829046:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9e6 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869481.829056:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9e6 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869481.829065:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda800, rc 0) 00000100:00100000:2.0:1788869481.829126:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325054464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869481.829133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788869481.831175:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869481.831209:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869481.831223:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869481.831325:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869481.831388:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869481.831438:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27028aee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869481.831795:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325054592 00000100:00100000:1.0:1788869481.831804:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325054592 00000100:00100000:1.0:1788869481.831859:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788869481.831868:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325054592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869481.832304:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325054592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 436us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869481.832312:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788869481.832409:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869481.832453:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869481.832519:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869481.832551:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d45900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869481.833767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325054720 00000100:00100000:2.0:1788869481.833780:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325054720 00000100:00100000:2.0:1788869481.833848:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788869481.833857:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325054720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869481.834171:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325054720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 314us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869481.834179:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788869481.834329:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325054720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869481.848383:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788869481.848703:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788869481.848728:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869481.848742:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869481.848756:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869482.305826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869482.306312:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305037056 00000100:00100000:2.0:1788869482.306325:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305037056 00000100:00100000:2.0:1788869482.306417:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 334 00000100:00100000:2.0:1788869482.306432:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+11:6181:x1875765305037056:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869482.306455:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869482.306494:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d1e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869482.306535:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d1e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869482.306547:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d1e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869482.306556:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda600, rc 0) 00000100:00100000:2.0:1788869482.306853:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305037056:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 422us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869482.306861:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 334 00000100:00100000:2.0:1788869482.326991:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869482.327136:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305037184 00000100:00100000:1.0:1788869482.327169:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305037184 00000100:00100000:1.0:1788869482.327234:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 335 00000100:00100000:1.0:1788869482.327245:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305037184:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869482.327412:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305037184:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 168us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869482.327421:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 335 00000100:00100000:2.0:1788869482.332295:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869482.332366:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305037312 00000100:00100000:1.0:1788869482.332377:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305037312 00000100:00100000:1.0:1788869482.332443:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 336 00000100:00100000:1.0:1788869482.332456:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305037312:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869482.336556:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305037312:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 4084us (4253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869482.336574:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 336 00000100:00100000:1.0:1788869482.353221:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869482.353422:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305037440 00000100:00100000:3.0:1788869482.353433:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305037440 00000100:00100000:3.0:1788869482.353495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 337 00000100:00100000:3.0:1788869482.353508:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305037440:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869482.353530:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869482.353554:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d25 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869482.353614:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d25 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869482.353653:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d25 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869482.353663:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe1000, rc 0) 00000100:00100000:3.0:1788869482.353726:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305037440:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 221us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869482.353735:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 337 00000100:00100000:0.0:1788869482.356363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869482.356469:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305037568 00000100:00100000:1.0:1788869482.356483:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305037568 00000100:00100000:1.0:1788869482.356553:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 338 00000100:00100000:1.0:1788869482.356564:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305037568:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869482.356774:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305037568:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 212us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869482.356782:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 338 00000100:00100000:0.0:1788869482.360710:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869482.360852:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305037696 00000100:00100000:1.0:1788869482.360881:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305037696 00000100:00100000:1.0:1788869482.360939:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 339 00000100:00100000:1.0:1788869482.360949:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305037696:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869482.361116:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305037696:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 168us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869482.361124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 339 00010000:00010000:2.0:1788869482.695556:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869482.824163:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325054848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869482.824260:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869482.824351:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325054848 00000100:00100000:3.0:1788869482.824361:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325054848 00000100:00100000:3.0:1788869482.824425:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788869482.824436:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325054848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869482.824474:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869482.824519:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325054848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869482.824526:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788869482.824546:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869482.824580:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840fcf100 x1875765325054848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869482.825155:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869482.825170:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325054976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869482.825215:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869482.825248:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325054976 00000100:00100000:2.0:1788869482.825253:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325054976 00000100:00100000:2.0:1788869482.825291:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869482.825299:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325054976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869482.825314:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869482.825350:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325054976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869482.825366:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1788869482.825398:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2841003800 x1875765325054976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869482.825414:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325054976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869482.825467:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325054848:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788869482.825488:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869483.722040:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869483.853195:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325055104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869483.853276:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869483.853391:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325055104 00000100:00100000:3.0:1788869483.853401:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325055104 00000100:00100000:3.0:1788869483.853449:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788869483.853457:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325055104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869483.853501:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869483.853555:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325055104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869483.853563:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788869483.853630:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325055104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869483.967098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869483.967147:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869483.967180:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869483.967201:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869483.967225:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869483.967258:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305037952 00000100:00100000:1.0:1788869483.967270:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305037952 00000100:00100000:1.0:1788869483.967327:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305038208 00000100:00100000:1.0:1788869483.967330:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305038208 00000100:00100000:1.0:1788869483.967345:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305038080 00000100:00100000:1.0:1788869483.967347:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305038080 00000100:00100000:1.0:1788869483.967358:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305038336 00000100:00100000:1.0:1788869483.967360:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305038336 00000100:00100000:1.0:1788869483.967376:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:1.0:1788869483.967385:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305037952:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869483.967465:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305037952:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 81us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869483.967473:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:1.0:1788869483.967509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:1.0:1788869483.967516:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305038208:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869483.967541:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305038208:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869483.967547:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:1.0:1788869483.967580:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:1.0:1788869483.967617:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305038080:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869483.967645:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305038080:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 59us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869483.967651:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:1.0:1788869483.967667:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:1.0:1788869483.967672:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305038336:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869483.967716:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305038336:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869483.967722:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:1.0:1788869483.967745:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305037824 00000100:00100000:1.0:1788869483.967749:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305037824 00000100:00100000:1.0:1788869483.967773:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 340 00000100:00100000:1.0:1788869483.967779:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305037824:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869483.967804:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305037824:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869483.967810:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 340 00000100:00080000:1.0:1788869483.967859:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869483.967863:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788869484.741936:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869484.870175:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325055488:0@lo:400:kworker.0 00000100:00100000:0.0:1788869484.870257:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869484.870337:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325056000:0@lo:400:kworker.0 00000100:00100000:0.0:1788869484.870366:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869484.870389:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325056512:0@lo:400:kworker.0 00000100:00100000:0.0:1788869484.870408:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869484.870437:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869484.870443:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325055616:0@lo:400:kworker.0 00000100:00100000:0.0:1788869484.870478:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869484.870494:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325056128:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.870617:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325055232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.870655:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869484.870680:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325055744:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.870702:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869484.870720:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325056256:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.870742:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869484.870760:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325056768:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.870780:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869484.870799:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788869484.870805:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325055360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.870841:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869484.870858:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325055872:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.870892:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869484.870905:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325056384:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.870925:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869484.870950:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325055488 00000100:00100000:3.0:1788869484.870967:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325055488 00000100:00100000:3.0:1788869484.871011:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325055744 00000100:00100000:3.0:1788869484.871014:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325055744 00000100:00100000:3.0:1788869484.871031:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788869484.871040:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325055488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.871095:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325055488:12345-0@lo:400:kworker.0 Request processed in 56us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869484.871102:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788869484.871120:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788869484.871126:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325055744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.871158:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325055744:12345-0@lo:400:kworker.0 Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869484.871164:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788869484.871182:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325056256 00000100:00100000:3.0:1788869484.871185:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325056256 00000100:00100000:3.0:1788869484.871215:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325056768 00000100:00100000:3.0:1788869484.871218:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325056768 00000100:00100000:3.0:1788869484.871237:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869484.871243:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325056256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.871273:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325056256:12345-0@lo:400:kworker.0 Request processed in 30us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869484.871279:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869484.871289:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869484.871295:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325056768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.871321:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325056768:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869484.871326:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869484.871353:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325056000 00000100:00100000:3.0:1788869484.871357:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325056000 00000100:00100000:3.0:1788869484.871374:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325056512 00000100:00100000:3.0:1788869484.871377:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325056512 00000100:00100000:3.0:1788869484.871389:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325055616 00000100:00100000:3.0:1788869484.871391:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325055616 00000100:00100000:3.0:1788869484.871401:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325055360 00000100:00100000:3.0:1788869484.871403:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325055360 00000100:00100000:3.0:1788869484.871414:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325055872 00000100:00100000:3.0:1788869484.871416:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325055872 00000100:00100000:3.0:1788869484.871427:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325056384 00000100:00100000:3.0:1788869484.871429:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325056384 00000100:00100000:3.0:1788869484.871442:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788869484.871448:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325056000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.871478:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325056000:12345-0@lo:400:kworker.0 Request processed in 30us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869484.871483:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788869484.871494:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788869484.871499:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325056512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.871712:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325056512:12345-0@lo:400:kworker.0 Request processed in 213us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869484.871719:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788869484.871731:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788869484.871737:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325055616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.871783:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325055616:12345-0@lo:400:kworker.0 Request processed in 46us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869484.871786:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788869484.871798:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325055360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.871807:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788869484.871831:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788869484.871838:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325055872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869484.871852:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325055360:12345-0@lo:400:kworker.0 Request processed in 56us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869484.871859:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788869484.871885:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788869484.871891:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325056384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869484.872367:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325056384:12345-0@lo:400:kworker.0 Request processed in 475us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869484.872374:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:1.0:1788869484.872404:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869484.872409:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869484.872412:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869484.872415:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869484.872635:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325055872:12345-0@lo:400:kworker.0 Request processed in 796us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869484.872643:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788869484.872696:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325055360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.872709:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325055872:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.872720:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325056384:0@lo:400:kworker.0 00000100:00100000:3.0:1788869484.872733:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325055744:0@lo:400:kworker.0 00010000:00080000:3.0:1788869484.872750:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f1f80 x1875765325056256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869484.872763:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325056256:0@lo:400:kworker.0 00010000:00080000:3.0:1788869484.872775:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703955500 x1875765325056768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869484.872783:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325056768:0@lo:400:kworker.0 00000100:00100000:1.0:1788869484.874319:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325055232 00000100:00100000:1.0:1788869484.874332:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325055232 00000100:00100000:1.0:1788869484.874385:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788869484.874394:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325055232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869484.874473:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325055232:12345-0@lo:400:kworker.0 Request processed in 80us (3818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869484.874479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788869484.874546:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325055232:0@lo:400:kworker.0 00000100:00100000:0.0:1788869484.880691:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869484.880750:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325056640:0@lo:400:kworker.0 00000100:00100000:0.0:1788869484.880795:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869484.880855:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325056128 00000100:00100000:0.0:1788869484.880863:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325056128 00000100:00100000:0.0:1788869484.881804:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325056640 00000100:00100000:0.0:1788869484.881813:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325056640 00000100:00100000:0.0:1788869484.881850:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788869484.881859:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325056128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869484.882004:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788869484.882015:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325056640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869484.882084:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325056640:12345-0@lo:400:kworker.0 Request processed in 73us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869484.882091:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869484.882908:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325056128:12345-0@lo:400:kworker.0 Request processed in 1047us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869484.882919:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1788869484.882954:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869484.882960:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869484.882998:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703954700 x1875765325056640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869484.883015:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325056640:0@lo:400:kworker.0 00000100:00100000:0.0:1788869484.883030:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325055488:0@lo:400:kworker.0 00010000:00080000:0.0:1788869484.883042:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283b472680 x1875765325056000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869484.883050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325056000:0@lo:400:kworker.0 00010000:00080000:0.0:1788869484.883061:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703955880 x1875765325056512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869484.883068:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325056512:0@lo:400:kworker.0 00000100:00100000:0.0:1788869484.883110:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325055616:0@lo:400:kworker.0 00010000:00080000:0.0:1788869484.883121:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283b470e00 x1875765325056128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869484.883130:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325056128:0@lo:400:kworker.0 00000100:00100000:1.0:1788869485.381901:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869485.381927:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325056896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869485.382008:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.382170:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325056896 00000100:00100000:3.0:1788869485.382179:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325056896 00000100:00100000:3.0:1788869485.382477:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869485.382492:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325056896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869485.382527:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869485.382639:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325056896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869485.382648:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1788869485.382669:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a9f80 x1875765325056896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869485.382700:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325056896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869485.382713:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869485.382914:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325057024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869485.382957:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.382984:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325057024 00000100:00100000:3.0:1788869485.382989:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325057024 00000100:00100000:3.0:1788869485.383279:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869485.383289:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325057024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869485.383301:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869485.383336:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325057024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869485.383342:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1788869485.383372:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a0380 x1875765325057024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869485.383387:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325057024:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788869485.762780:0:13395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788869485.767659:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869486.789928:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869486.918416:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325057152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869486.918506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869486.921754:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325057152 00000100:00100000:2.0:1788869486.921771:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325057152 00000100:00100000:2.0:1788869486.921853:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788869486.921864:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325057152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869486.921902:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869486.922005:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325057152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (3499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869486.922012:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788869486.922415:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325057152:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869487.813981:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869487.944489:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869487.944513:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325057280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869487.944583:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869487.945389:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325057280 00000100:00100000:1.0:1788869487.945398:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325057280 00000100:00100000:1.0:1788869487.945465:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788869487.945477:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325057280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869487.945514:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869487.945583:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325057280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869487.945607:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788869487.945648:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869487.945686:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a9f80 x1875765325057280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869487.945710:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325057280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869487.947206:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869487.947225:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325057408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869487.947285:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869487.947523:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325057408 00000100:00100000:3.0:1788869487.947531:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325057408 00000100:00100000:3.0:1788869487.947635:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788869487.947645:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325057408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869487.947666:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869487.947715:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325057408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869487.947722:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1788869487.947790:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a0380 x1875765325057408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869487.947807:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325057408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788869487.948243:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869488.841649:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869488.969140:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325057536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869488.969209:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869488.970781:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325057536 00000100:00100000:3.0:1788869488.970793:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325057536 00000100:00100000:3.0:1788869488.971950:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788869488.971965:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325057536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869488.972009:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869488.972239:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325057536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 277us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.972248:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788869488.972307:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325057536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869489.084964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869489.085306:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305038592 00000100:00100000:1.0:1788869489.085319:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305038592 00000100:00100000:2.0:1788869489.085504:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869489.087990:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869489.088032:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869489.088062:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869489.088104:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305038464 00000100:00100000:2.0:1788869489.088116:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305038464 00000100:00100000:2.0:1788869489.088176:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 342 00000100:00100000:2.0:1788869489.088188:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2409:x1875765305038464:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869489.088285:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2409:x1875765305038464:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 99us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869489.088294:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 342 00000100:00080000:0.0:1788869489.091388:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869489.091545:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305038848 00000100:00100000:1.0:1788869489.091559:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305038848 00000100:00080000:1.0:1788869489.091638:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869489.091664:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305038720 00000100:00100000:1.0:1788869489.091669:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305038720 00000100:00080000:1.0:1788869489.091681:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869489.091709:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305038976 00000100:00100000:1.0:1788869489.091712:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305038976 00000100:00080000:1.0:1788869489.091725:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869489.091763:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:1.0:1788869489.091792:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305038592:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869489.092028:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305038592:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 238us (8001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869489.092283:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:1.0:1788869489.092324:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:1.0:1788869489.092333:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305038848:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869489.092365:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305038848:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (6863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869489.092371:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:1.0:1788869489.092384:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:1.0:1788869489.092389:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305038720:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869489.092413:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305038720:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (4380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869489.092418:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:1.0:1788869489.092432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:1.0:1788869489.092439:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305038976:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869489.092461:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305038976:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869489.092468:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 237 00010000:00010000:2.0:1788869489.861860:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869489.989932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325058048:0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.990024:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869489.990078:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325058560:0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.990102:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869489.990116:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325059072:0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.990135:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869489.990157:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788869489.990163:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325057664:0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.990186:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869489.990318:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325058048 00000100:00100000:0.0:1788869489.990329:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325058048 00000100:00100000:0.0:1788869489.990389:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788869489.990400:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325058048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869489.990457:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325058048:12345-0@lo:400:kworker.0 Request processed in 58us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869489.990465:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788869489.990545:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325058176:0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.990572:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869489.990629:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325058688:0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.990655:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869489.990660:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325057920:0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.990674:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325059200:0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.990693:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869489.990694:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869489.990714:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325058432:0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.990748:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325058048:0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.990751:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869489.990778:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325057792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.990778:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325058944:0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.990798:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869489.990806:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325058560 00000100:00100000:3.0:1788869489.990810:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325058560 00000100:00100000:3.0:1788869489.990847:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325059072 00000100:00100000:3.0:1788869489.990850:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325059072 00000100:00100000:3.0:1788869489.990862:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325058688 00000100:00100000:3.0:1788869489.990864:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325058688 00000100:00100000:3.0:1788869489.990877:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325059200 00000100:00100000:3.0:1788869489.990880:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325059200 00000100:00100000:3.0:1788869489.990893:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869489.990901:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325058560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869489.990959:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325058176 00000100:00100000:0.0:1788869489.990964:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325058176 00000100:00100000:0.0:1788869489.990997:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325057920 00000100:00100000:0.0:1788869489.991000:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325057920 00000100:00100000:0.0:1788869489.991013:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788869489.991019:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325058176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.995421:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325058560:12345-0@lo:400:kworker.0 Request processed in 4507us (5304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869489.995480:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869489.995538:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788869489.995552:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325059072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.995627:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325059072:12345-0@lo:400:kworker.0 Request processed in 82us (5491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869489.995634:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788869489.995648:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788869489.995655:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325058688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869489.996676:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325058688:12345-0@lo:400:kworker.0 Request processed in 1015us (6012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869489.996688:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788869489.996717:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788869489.996740:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325059200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869489.996834:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325058176:12345-0@lo:400:kworker.0 Request processed in 5812us (6257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869489.996844:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788869489.996868:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788869489.996876:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325057920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869489.996919:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325057920:12345-0@lo:400:kworker.0 Request processed in 44us (6224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869489.996925:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788869489.997091:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325057920:0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997206:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325058432 00000100:00100000:1.0:1788869489.997215:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325058432 00000100:00100000:1.0:1788869489.997259:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325058944 00000100:00100000:1.0:1788869489.997262:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325058944 00000100:00100000:1.0:1788869489.997275:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788869489.997280:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325058432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997328:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325058432:12345-0@lo:400:kworker.0 Request processed in 48us (6576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869489.997335:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788869489.997358:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788869489.997363:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325058944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997386:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325058944:12345-0@lo:400:kworker.0 Request processed in 24us (6588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869489.997391:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788869489.997411:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869489.997442:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325058304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997470:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869489.997479:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325058816:0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997494:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869489.997511:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325057792 00000100:00100000:1.0:1788869489.997513:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325057792 00000100:00100000:1.0:1788869489.997526:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325058304 00000100:00100000:1.0:1788869489.997528:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325058304 00000100:00100000:1.0:1788869489.997538:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325058816 00000100:00100000:1.0:1788869489.997552:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325058816 00000100:00100000:1.0:1788869489.997566:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788869489.997570:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325057792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997623:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325057792:12345-0@lo:400:kworker.0 Request processed in 53us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869489.997629:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788869489.997642:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788869489.997647:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325058304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997668:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325058304:12345-0@lo:400:kworker.0 Request processed in 21us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869489.997673:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788869489.997682:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788869489.997686:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325058816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997704:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325058816:12345-0@lo:400:kworker.0 Request processed in 18us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869489.997709:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788869489.997747:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325057792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997756:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325058304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869489.997763:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325058816:0@lo:400:kworker.0 00010000:00080000:1.0:1788869489.997928:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703956d80 x1875765325058432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869489.997940:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325058432:0@lo:400:kworker.0 00010000:00080000:1.0:1788869489.997954:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703955500 x1875765325058944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869489.997976:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325058944:0@lo:400:kworker.0 00000100:00100000:3.0:1788869490.001924:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325059200:12345-0@lo:400:kworker.0 Request processed in 5187us (11217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869490.001939:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788869490.002018:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325057664 00000100:00100000:3.0:1788869490.002027:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325057664 00000100:00100000:3.0:1788869490.002091:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788869490.002102:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325057664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869490.002151:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325057664:12345-0@lo:400:kworker.0 Request processed in 52us (11963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869490.002157:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:3.0:1788869490.002284:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869490.002291:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869490.002296:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869490.002299:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869490.002345:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325057664:0@lo:400:kworker.0 00000100:00100000:3.0:1788869490.002366:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325058176:0@lo:400:kworker.0 00010000:00080000:3.0:1788869490.002382:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703956a00 x1875765325058688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869490.002395:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325058688:0@lo:400:kworker.0 00010000:00080000:3.0:1788869490.002408:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703bab480 x1875765325059200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869490.002428:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325059200:0@lo:400:kworker.0 00010000:00080000:3.0:1788869490.002447:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703956300 x1875765325058560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869490.002454:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325058560:0@lo:400:kworker.0 00010000:00080000:3.0:1788869490.002467:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703ba8a80 x1875765325059072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869490.002474:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325059072:0@lo:400:kworker.0 00000100:00100000:1.0:1788869490.504905:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325059328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869490.504987:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869490.505052:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325059328 00000100:00100000:1.0:1788869490.505064:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869490.505071:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325059456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869490.505093:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869490.505129:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325059456 00000100:00100000:1.0:1788869490.505140:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325059456 00000100:00100000:0.0:1788869490.505147:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325059328 00000100:00100000:0.0:1788869490.505191:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788869490.505200:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325059328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869490.505246:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869490.505366:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325059328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869490.505374:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788869490.505392:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788869490.505400:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325059456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869490.505410:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869490.505435:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325059456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869490.505440:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1788869490.505785:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703baa680 x1875765325059328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869490.505805:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325059328:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788869490.505831:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703bab100 x1875765325059456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869490.505840:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325059456:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869490.898990:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869491.914553:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869492.052932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325059584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869492.053032:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869492.053109:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325059584 00000100:00100000:3.0:1788869492.053121:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325059584 00000100:00100000:3.0:1788869492.053190:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788869492.053201:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325059584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869492.053251:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869492.053315:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325059584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869492.053323:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788869492.053352:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325059584:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788869492.104247:0:13544:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:11:29 (1788869489) === 00000100:00100000:1.0:1788869492.394483:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869492.394555:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869492.394795:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305039104 00000100:00100000:2.0:1788869492.394808:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305039104 00000100:00100000:2.0:1788869492.394904:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1788869492.394915:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305039104:12345-192.168.204.54@tcp:41:mkdir.0 00000004:00000024:2.0:1788869492.394981:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869492.395153:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305039104:12345-192.168.204.54@tcp:41:mkdir.0 Request processed in 240us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869492.395161:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00080000:3.0:1788869492.395279:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869492.395364:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305039232 00000100:00100000:0.0:1788869492.395369:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305039232 00000100:00100000:0.0:1788869492.395408:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1788869492.395417:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:10519:x1875765305039232:12345-192.168.204.54@tcp:700:mkdir.0 00000100:00100000:0.0:1788869492.395457:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:10519:x1875765305039232:12345-192.168.204.54@tcp:700:mkdir.0 Request processed in 42us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869492.395464:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788869492.404532:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869492.405301:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305039488 00000100:00100000:0.0:1788869492.405327:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305039488 00000100:00100000:0.0:1788869492.407141:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788869492.407169:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:10519:x1875765305039488:12345-192.168.204.54@tcp:36:mkdir.0 00010000:00010000:0.0:1788869492.407253:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869492.407345:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ce8a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c99 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.407371:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803eb7100) 00010000:00010000:0.0:1788869492.407386:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869492.407484:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.407499:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.407509:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.407523:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.407530:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.407536:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408193:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408205:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408219:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869492.408235:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afbc2e7e reply state 0000000007502637 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408246:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408253:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2803eb7800) 00010000:00010000:0.0:1788869492.408255:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869492.408259:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788869492.408263:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788869492.408269:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408276:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408283:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408288:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869492.408292:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408299:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408306:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803eb7b00) 00010000:00010000:0.0:1788869492.408308:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869492.408320:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408327:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869492.408343:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afbc2e7e reply state 0000000007502637 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408350:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.408355:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2803eb7a00) 00010000:00010000:0.0:1788869492.408357:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869492.408359:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788869492.408459:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:10519:x1875765305039488:12345-192.168.204.54@tcp:36:mkdir.0 Request processed in 1302us (3940us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788869492.408468:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1788869492.426013:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869492.430786:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305039616 00000100:00100000:2.0:1788869492.430808:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305039616 00000100:00100000:2.0:1788869492.430914:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1788869492.430927:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:10523:x1875765305039616:12345-192.168.204.54@tcp:101:chmod.0 00010000:00010000:2.0:1788869492.430960:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869492.430998:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d2c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.431798:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.431816:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.431830:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869492.431893:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869492.431899:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869492.431948:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.431981:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d2c expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.432005:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d2c expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.432014:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9be00) 00010000:00010000:2.0:1788869492.432017:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869492.432021:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda400, rc 0) 00000100:00100000:2.0:1788869492.432763:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:10523:x1875765305039616:12345-192.168.204.54@tcp:101:chmod.0 Request processed in 1835us (6761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869492.432773:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:1.0:1788869492.454529:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869492.456020:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305039872 00000100:00100000:2.0:1788869492.456049:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305039872 00000100:00100000:2.0:1788869492.456152:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1788869492.456164:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:10523:x1875765305039872:12345-192.168.204.54@tcp:36:chmod.0 00010000:00010000:2.0:1788869492.456244:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869492.456511:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d2c expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.456534:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9be00) 00010000:00010000:2.0:1788869492.456547:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869492.456579:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.456744:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.456756:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869492.456982:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7bb4b0a reply state 000000002152a7f1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.456995:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.457002:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869492.457005:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788869492.457008:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788869492.457016:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788869492.457125:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:10523:x1875765305039872:12345-192.168.204.54@tcp:36:chmod.0 Request processed in 962us (2609us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788869492.457133:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788869492.492740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869492.492868:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305040000 00000100:00100000:1.0:1788869492.492879:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305040000 00000100:00100000:1.0:1788869492.492949:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1788869492.492962:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:10525:x1875765305040000:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:1.0:1788869492.492989:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869492.493016:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d33 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.493098:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cea33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.493114:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cea33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.493125:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cea33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869492.493203:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869492.493207:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869492.493246:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cea33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.493283:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d33 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.493302:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cea33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d33 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.493310:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869492.493313:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869492.493317:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e600, rc 0) 00000100:00100000:1.0:1788869492.493370:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:10525:x1875765305040000:12345-192.168.204.54@tcp:101:chown.0 Request processed in 411us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869492.493376:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1788869492.501373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869492.508121:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305040128 00000100:00100000:0.0:1788869492.508139:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305040128 00000100:00100000:0.0:1788869492.508434:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1788869492.508447:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:10525:x1875765305040128:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:0.0:1788869492.508469:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869492.508493:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6cea3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d3a expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508573:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508624:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508659:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508673:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508694:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508701:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508804:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508814:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508820:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869492.508867:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869492.508871:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869492.508895:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508909:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508916:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508935:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508942:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869492.508947:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508955:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508969:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869492.508973:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869492.508979:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.508986:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509001:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509008:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509013:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509018:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869492.509033:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509049:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509058:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2803eb7a00) 00010000:00010000:0.0:1788869492.509060:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869492.509063:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509068:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cea48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509095:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6cea3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d3a expref: 12 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509109:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d3a expref: 11 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.509116:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2803eb7800) 00010000:00010000:0.0:1788869492.509119:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869492.509121:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5000, rc 0) 00000100:00100000:0.0:1788869492.509204:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:10525:x1875765305040128:12345-192.168.204.54@tcp:101:chown.0 Request processed in 758us (7842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869492.509212:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1788869492.512800:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869492.512896:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305040256 00000100:00100000:2.0:1788869492.512908:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305040256 00000100:00100000:2.0:1788869492.512979:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788869492.512992:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:10525:x1875765305040256:12345-192.168.204.54@tcp:900:chown.0 00000100:00100000:2.0:1788869492.513111:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:10525:x1875765305040256:12345-192.168.204.54@tcp:900:chown.0 Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869492.513119:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788869492.525083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869492.525480:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305040512 00000100:00100000:2.0:1788869492.525491:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305040512 00000100:00100000:2.0:1788869492.525560:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788869492.525571:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:10525:x1875765305040512:12345-192.168.204.54@tcp:36:chown.0 00010000:00010000:2.0:1788869492.525690:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869492.525718:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cea4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d3a expref: 11 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.525740:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2803eb7800) 00010000:00010000:2.0:1788869492.525744:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869492.525771:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.525787:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.525811:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869492.530433:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1788869492.530620:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530650:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530658:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530664:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869492.530669:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530691:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530708:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2803eb7a00) 00010000:00010000:2.0:1788869492.530711:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869492.530716:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530723:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cea09 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530744:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530750:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530756:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530761:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869492.530771:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530777:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530786:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2803eb7800) 00010000:00010000:2.0:1788869492.530789:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869492.530804:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530811:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cea10 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530827:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530833:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530839:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530845:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869492.530848:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530853:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530861:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869492.530864:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869492.530872:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.530878:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cea25 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869492.532114:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dcddbfe reply state 00000000260123e3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.532139:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.532149:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2803eb7800) 00010000:00010000:1.0:1788869492.532152:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788869492.532157:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788869492.532171:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788869492.532809:0:6526:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788869492.533031:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:10525:x1875765305040512:12345-192.168.204.54@tcp:36:chown.0 Request processed in 7456us (7955us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788869492.533042:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00010000:00010000:2.0:1788869492.537914:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.537939:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.537949:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.537956:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869492.537961:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.537969:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.537996:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2803eb7800) 00010000:00010000:2.0:1788869492.537999:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869492.538006:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.538012:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea56 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869492.572712:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869492.572848:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305040640 00000100:00100000:2.0:1788869492.572859:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305040640 00000100:00100000:2.0:1788869492.572924:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1788869492.572951:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:10526:x1875765305040640:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:2.0:1788869492.572981:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869492.573006:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d41 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869492.575292:0:6525:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2222us 00010000:00010000:1.0:1788869492.610478:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611052:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611068:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611091:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611099:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611106:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611225:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cea72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611233:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cea72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611240:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cea72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869492.611287:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869492.611292:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869492.611353:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cea72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611367:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611374:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611381:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611388:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869492.611393:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611399:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611411:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869492.611414:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869492.611418:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611424:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611449:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611456:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611461:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611473:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869492.611476:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611482:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611502:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2701ecc300) 00010000:00010000:1.0:1788869492.611506:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869492.611509:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611514:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611577:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cea5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d41 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611618:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cea72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d41 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.611626:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2701eccc00) 00010000:00010000:1.0:1788869492.611628:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788869492.611631:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f400, rc 0) 00000100:00100000:1.0:1788869492.611717:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:10526:x1875765305040640:12345-192.168.204.54@tcp:101:touch.500 Request processed in 38767us (39013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869492.611726:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1788869492.630514:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869492.630721:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305040896 00000100:00100000:1.0:1788869492.630738:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305040896 00000100:00100000:1.0:1788869492.630811:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1788869492.630823:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:10526:x1875765305040896:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:1.0:1788869492.630851:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869492.630873:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea79 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d48 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.630990:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.631151:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.631165:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.631296:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.631306:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.631312:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869492.632770:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788869492.633752:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cea8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.633783:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cea8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.633922:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cea8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.633966:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.633973:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.633981:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.633987:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869492.633991:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.634324:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.634341:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2701eccc00) 00010000:00010000:1.0:1788869492.634344:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869492.634350:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.634356:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cea80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869492.634375:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3f5090b reply state 000000002a5bd0c9 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.634386:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.634400:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8e2701ecc300) 00010000:00010000:1.0:1788869492.634402:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869492.634405:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788869492.634448:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cea79 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d48 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.634465:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cea8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d48 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.634473:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2701ecc000) 00010000:00010000:1.0:1788869492.634475:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869492.634477:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7fa00, rc 0) 00000100:00100000:1.0:1788869492.634749:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:10526:x1875765305040896:12345-192.168.204.54@tcp:101:touch.500 Request processed in 3927us (4245us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788869492.634766:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788869492.646958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869492.652409:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305041152 00000100:00100000:3.0:1788869492.652442:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305041152 00000100:00100000:0.0:1788869492.652924:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1788869492.652938:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:10526:x1875765305041152:12345-192.168.204.54@tcp:36:touch.500 00010000:00010000:0.0:1788869492.653088:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869492.653121:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cea8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d48 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.653140:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2701ecc000) 00010000:00010000:0.0:1788869492.653167:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869492.653299:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.653313:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.653324:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869492.653427:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d9397ec reply state 000000009e76a37f transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.653439:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.653445:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2809bdcb00) 00010000:00010000:0.0:1788869492.653448:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869492.653451:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869492.653658:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:10526:x1875765305041152:12345-192.168.204.54@tcp:36:touch.500 Request processed in 723us (6710us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788869492.653665:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:2.0:1788869492.656983:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869492.658734:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305041280 00000100:00100000:1.0:1788869492.658750:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305041280 00000100:00100000:1.0:1788869492.659340:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:1.0:1788869492.659353:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:10526:x1875765305041280:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:1.0:1788869492.659380:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869492.659402:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ceaa3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d4f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.659476:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ceaa3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d4f expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.659492:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ceaa3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d4f expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.659534:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2809bdcb00) 00010000:00010000:1.0:1788869492.659538:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869492.659543:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f000, rc 0) 00000100:00100000:1.0:1788869492.659658:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:10526:x1875765305041280:12345-192.168.204.54@tcp:101:touch.500 Request processed in 307us (2687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869492.659665:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1788869492.665439:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869492.665636:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305041408 00000100:00100000:3.0:1788869492.665647:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305041408 00000100:00100000:3.0:1788869492.665708:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1788869492.665718:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1875765305041408:12345-192.168.204.54@tcp:8:touch.500 00010000:00080000:3.0:1788869492.665828:0:8442:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:3.0:1788869492.665862:0:8442:0:(genops.c:1384:class_connect()) connect: client 91cba2f3-33fb-476e-a4a1-b4fbee1b176d, cookie 0x4c16c38a9b6ceaaa 00002000:00100000:3.0:1788869492.665874:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 91cba2f3-33fb-476e-a4a1-b4fbee1b176d/ffff8e27036c0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869492.665894:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869492.666067:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788869492.666215:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8e27036c5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869492.666403:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2406:x1875765305041408:12345-192.168.204.54@tcp:8:touch.500 Request processed in 684us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869492.666411:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788869492.671468:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869492.671567:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305041536 00000100:00100000:3.0:1788869492.671578:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305041536 00000100:00100000:3.0:1788869492.671706:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788869492.671718:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:0:x1875765305041536:12345-192.168.204.54@tcp:2:touch.500 00000100:00080000:1.0:1788869492.672067:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788869492.680885:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1788869492.681137:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000100:00100000:3.0:1788869492.681422:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:0:x1875765305041536:12345-192.168.204.54@tcp:2:touch.500 Request processed in 9697us (9958us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788869492.681436:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1788869492.687420:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869492.687545:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305041792 00000100:00100000:0.0:1788869492.687557:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305041792 00000100:00100000:0.0:1788869492.687713:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1788869492.687724:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:10526:x1875765305041792:12345-192.168.204.54@tcp:35:touch.500 00000100:00100000:0.0:1788869492.688108:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:10526:x1875765305041792:12345-192.168.204.54@tcp:35:touch.500 Request processed in 384us (697us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788869492.688116:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788869492.729827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869492.730719:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305041920 00000100:00100000:1.0:1788869492.730733:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305041920 00000100:00100000:1.0:1788869492.730816:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1788869492.730827:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:10528:x1875765305041920:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:1.0:1788869492.730852:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869492.730874:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6ceab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d56 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.731117:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6ceab8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.731133:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6ceab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.731145:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6ceab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869492.731195:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869492.731199:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869492.731241:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6ceab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.731287:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6ceab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d56 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.731308:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6ceab8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d56 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.731317:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2701eccc00) 00010000:00010000:1.0:1788869492.731320:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869492.731324:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7fa00, rc 0) 00000100:00100000:1.0:1788869492.731394:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:10528:x1875765305041920:12345-192.168.204.54@tcp:101:rm.0 Request processed in 569us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869492.731401:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788869492.749245:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869492.749572:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305042176 00000100:00100000:2.0:1788869492.749584:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305042176 00000100:00100000:1.0:1788869492.750215:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1788869492.750231:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:10528:x1875765305042176:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:1.0:1788869492.750255:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869492.750281:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6ceabf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d5d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869492.752001:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788869492.752188:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6ceabf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d5d expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.752206:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869492.752209:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869492.752214:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6ceabf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d5d expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869492.752246:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e800, rc 0) 00000100:00100000:1.0:1788869492.752340:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:10528:x1875765305042176:12345-192.168.204.54@tcp:101:rm.0 Request processed in 2113us (3106us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1788869492.752349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1788869492.759729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869492.759816:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305042304 00000100:00100000:2.0:1788869492.759826:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305042304 00000100:00100000:2.0:1788869492.759879:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1788869492.759887:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:10528:x1875765305042304:12345-192.168.204.54@tcp:37:rm.0 00000100:00100000:0.0:1788869492.765873:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:10528:x1875765305042304:12345-192.168.204.54@tcp:37:rm.0 Request processed in 5972us (6141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869492.765888:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788869492.778165:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869492.778299:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305042560 00000100:00100000:0.0:1788869492.778312:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305042560 00000100:00100000:0.0:1788869492.778394:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788869492.778405:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28268b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:10528:x1875765305042560:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:0.0:1788869492.778722:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28268b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:10528:x1875765305042560:12345-192.168.204.54@tcp:35:rm.0 Request processed in 318us (569us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788869492.778730:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788869492.785464:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869492.785569:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305042816 00000100:00100000:0.0:1788869492.785581:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305042816 00000100:00100000:0.0:1788869492.786527:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788869492.786540:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:10528:x1875765305042816:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:0.0:1788869492.786565:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869492.786611:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6ceacd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d64 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.786774:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cead4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.786789:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cead4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.786800:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cead4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869492.786812:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788869492.786951:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6ceacd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d64 expref: 19 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.786971:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cead4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d64 expref: 18 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.786980:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2701eccc00) 00010000:00010000:0.0:1788869492.786983:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869492.786986:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4800, rc 0) 00000100:00100000:0.0:1788869492.787060:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:10528:x1875765305042816:12345-192.168.204.54@tcp:101:rm.0 Request processed in 523us (1607us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788869492.787066:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1788869492.794708:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869492.794949:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305042944 00000100:00100000:3.0:1788869492.794961:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305042944 00000100:00100000:3.0:1788869492.795024:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1788869492.795037:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:10528:x1875765305042944:12345-192.168.204.54@tcp:41:rm.0 00000004:00000024:3.0:1788869492.795132:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788869492.795221:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:10528:x1875765305042944:12345-192.168.204.54@tcp:41:rm.0 Request processed in 185us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869492.795229:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1788869492.803280:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869492.803357:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305043072 00000100:00100000:0.0:1788869492.803375:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305043072 00000100:00100000:0.0:1788869492.803460:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1788869492.803471:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:10528:x1875765305043072:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:0.0:1788869492.803493:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869492.803638:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6ceae2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d6b expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803739:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803758:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803772:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803785:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803792:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803798:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803880:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6ceaf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803888:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6ceaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803895:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6ceaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869492.803942:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788869492.803947:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869492.803965:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6ceaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803983:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6ceaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803992:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.803997:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804004:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804009:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869492.804014:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804021:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804034:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2701eccc00) 00010000:00010000:0.0:1788869492.804037:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869492.804042:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804048:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6ceae9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804062:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804068:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804079:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804084:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869492.804086:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804092:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804100:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8e2701ecc300) 00010000:00010000:0.0:1788869492.804102:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869492.804105:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804109:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6ceaf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804135:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6ceae2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d6b expref: 20 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804148:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6ceaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d6b expref: 19 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869492.804155:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2809bdcb00) 00010000:00010000:0.0:1788869492.804156:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869492.804159:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4000, rc 0) 00000100:00100000:0.0:1788869492.804239:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:10528:x1875765305043072:12345-192.168.204.54@tcp:101:rm.0 Request processed in 770us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869492.804256:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1788869492.814373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869492.814478:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305043328 00000100:00100000:3.0:1788869492.814491:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305043328 00000100:00100000:3.0:1788869492.814562:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1788869492.814573:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:10528:x1875765305043328:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:3.0:1788869492.815870:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788869492.815941:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6ceaf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d6b expref: 19 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.815978:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ceaa3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d4f expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.815990:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2809bdcb00) 00010000:00010000:3.0:1788869492.816002:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6ceab8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d56 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816011:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2701eccc00) 00010000:00010000:3.0:1788869492.816015:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869492.816040:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816053:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816062:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816092:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816100:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816106:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816246:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816254:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816261:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869492.816487:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788869492.816497:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426729909943ns, next at 427729907126ns, rc = 0 00010000:00010000:3.0:1788869492.816546:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816556:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816565:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.816573:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.817361:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.817367:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817466:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869492.817497:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817503:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817510:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817527:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe1c00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869492.817532:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817540:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817552:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2809bdcb00) 00010000:00010000:2.0:1788869492.817556:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788869492.817560:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817565:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb0c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817612:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817617:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817622:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817627:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe1200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869492.817630:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817635:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817663:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2701eccc00) 00010000:00010000:2.0:1788869492.817666:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869492.817678:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817684:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1200/0x4c16c38a9b6ceafe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869492.817694:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b421a39 reply state 00000000476c12d2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817706:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.817713:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8e2701ecc300) 00010000:00010000:2.0:1788869492.817716:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869492.817719:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869492.817822:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:10528:x1875765305043328:12345-192.168.204.54@tcp:36:rm.0 Request processed in 3248us (3458us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788869492.817831:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00010000:00010000:3.0:1788869492.818475:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869492.818484:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.818490:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe0a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869492.818494:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.818500:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.818510:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2809bdcb00) 00010000:00010000:3.0:1788869492.818512:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788869492.818515:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.818519:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb13 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869492.818529:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869492.818531:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869492.818532:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869492.822569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869492.822686:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305043584 00000100:00100000:0.0:1788869492.822697:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305043584 00000100:00100000:0.0:1788869492.822749:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788869492.822759:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:10528:x1875765305043584:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:0.0:1788869492.823000:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:10528:x1875765305043584:12345-192.168.204.54@tcp:35:rm.0 Request processed in 242us (442us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788869492.823008:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788869492.836985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869492.837112:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305043840 00000100:00100000:2.0:1788869492.837124:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305043840 00000100:00100000:2.0:1788869492.837201:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1788869492.837213:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:10528:x1875765305043840:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:2.0:1788869492.837286:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788869492.837316:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cead4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d64 expref: 19 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.837374:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cea72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d41 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.837386:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2701eccc00) 00010000:00010000:2.0:1788869492.837415:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cea33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d33 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.837423:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869492.837429:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869492.837455:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.837468:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.837479:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.837493:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.837500:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.837506:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838065:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838087:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838095:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869492.838356:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788869492.838375:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838383:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838390:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838397:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869492.838402:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838410:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838421:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e2803b9be00) 00010000:00010000:2.0:1788869492.838424:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788869492.838429:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838435:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6ceb28 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838459:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838471:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838478:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838483:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869492.838486:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838492:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838500:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b900) 00010000:00010000:2.0:1788869492.838502:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869492.838505:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838510:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ceb1a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869492.838522:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003337693e reply state 0000000056a20e50 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838532:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869492.838538:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2803b9b100) 00010000:00010000:2.0:1788869492.838540:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869492.838544:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869492.838900:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:10528:x1875765305043840:12345-192.168.204.54@tcp:36:rm.0 Request processed in 1686us (1926us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788869492.838915:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00010000:00010000:3.0:1788869492.933892:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869493.061912:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869493.061952:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325059712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869493.062004:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325059840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869493.062090:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869493.062217:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869493.062278:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325059712 00000100:00100000:2.0:1788869493.062290:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325059712 00000100:00100000:2.0:1788869493.062365:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325059840 00000100:00100000:2.0:1788869493.062369:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325059840 00000100:00100000:2.0:1788869493.062393:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788869493.062405:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325059712:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869493.062443:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788869493.062764:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869493.062839:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325059712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 436us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869493.062847:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788869493.062865:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788869493.062872:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325059840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869493.062883:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869493.062908:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325059840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869493.062914:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1788869493.063009:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f0b100 x1875765325059840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869493.063032:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325059840:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788869493.063075:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703954700 x1875765325059712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869493.063088:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325059712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869493.957991:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869494.087727:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325059968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869494.087804:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869494.087974:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325059968 00000100:00100000:3.0:1788869494.087984:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325059968 00000100:00100000:3.0:1788869494.088052:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788869494.088063:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325059968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869494.088104:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869494.088170:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325059968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869494.088178:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788869494.088489:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325059968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869494.201789:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869494.201834:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869494.201875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869494.201901:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869494.201913:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305044096 00000100:00100000:2.0:1788869494.201917:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869494.201925:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305044096 00000100:00100000:2.0:1788869494.201945:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869494.201967:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305044352 00000100:00100000:2.0:1788869494.201970:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305044352 00000100:00100000:3.0:1788869494.201978:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305044608 00000100:00100000:3.0:1788869494.201981:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305044608 00000100:00100000:3.0:1788869494.201992:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305044224 00000100:00100000:3.0:1788869494.201994:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305044224 00000100:00100000:2.0:1788869494.201998:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:3.0:1788869494.202003:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305044480 00000100:00100000:3.0:1788869494.202005:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305044480 00000100:00100000:2.0:1788869494.202007:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305044352:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869494.202017:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:3.0:1788869494.202023:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:2408:x1875765305044096:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869494.202102:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305044352:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869494.202110:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:2.0:1788869494.202136:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 245 00000100:00100000:2.0:1788869494.202144:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305044608:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869494.202217:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:2408:x1875765305044096:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 193us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.202238:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305043968 00000100:00100000:0.0:1788869494.202243:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305043968 00000100:00100000:0.0:1788869494.202274:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 344 00000100:00100000:0.0:1788869494.202281:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305043968:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869494.202291:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:3.0:1788869494.202306:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 246 00000100:00100000:3.0:1788869494.202312:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305044224:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869494.202312:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305043968:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.202318:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 344 00000100:00100000:3.0:1788869494.202337:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305044224:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869494.202352:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 246 00000100:00080000:0.0:1788869494.202360:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869494.202362:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00080000:0.0:1788869494.202365:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869494.202367:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869494.202368:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305044480:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869494.202391:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305044480:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869494.202396:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:2.0:1788869494.202848:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305044608:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 704us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869494.202856:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 245 00010000:00010000:3.0:1788869494.983578:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869495.110111:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325060224:0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.110145:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325060352:0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.110183:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869495.110183:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869495.110227:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325060096:0@lo:400:kworker.0 00000100:00100000:2.0:1788869495.110507:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325060352 00000100:00100000:2.0:1788869495.110517:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325060352 00000100:00100000:2.0:1788869495.110567:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788869495.110575:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325060352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.115651:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325060864:0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.115727:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869495.115777:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325061376:0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.115799:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869495.115832:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788869495.115839:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325060480:0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.115861:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869495.115878:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325060992:0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.115904:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869495.115923:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325061504:0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.115962:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869495.116008:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325060224 00000100:00100000:3.0:1788869495.116017:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325060224 00000100:00100000:3.0:1788869495.116059:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325060864 00000100:00100000:3.0:1788869495.116062:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325060864 00000100:00100000:3.0:1788869495.116104:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325061376 00000100:00100000:3.0:1788869495.116108:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325061376 00000100:00100000:3.0:1788869495.116121:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325060480 00000100:00100000:3.0:1788869495.116123:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325060480 00000100:00100000:3.0:1788869495.116144:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788869495.116152:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325060224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.116222:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325060224:12345-0@lo:400:kworker.0 Request processed in 70us (6038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869495.116230:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788869495.116248:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788869495.116254:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325060864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.116290:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325060864:12345-0@lo:400:kworker.0 Request processed in 36us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869495.116296:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788869495.116309:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788869495.116315:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325061376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.116342:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325061376:12345-0@lo:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869495.116347:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788869495.116358:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788869495.116364:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325060480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.116388:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325060480:12345-0@lo:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869495.116393:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788869495.116428:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325060992 00000100:00100000:3.0:1788869495.116431:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325060992 00000100:00100000:3.0:1788869495.116455:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325061504 00000100:00100000:3.0:1788869495.116464:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325061504 00000100:00100000:3.0:1788869495.116493:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869495.116499:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325060992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.116533:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325060992:12345-0@lo:400:kworker.0 Request processed in 35us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869495.116539:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869495.116550:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788869495.116556:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325061504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869495.116635:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325061504:12345-0@lo:400:kworker.0 Request processed in 28us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869495.116643:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788869495.116665:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869495.116670:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869495.116673:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869495.116712:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325060480:0@lo:400:kworker.0 00010000:00080000:3.0:1788869495.116725:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d6680 x1875765325060992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869495.116736:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325060992:0@lo:400:kworker.0 00010000:00080000:3.0:1788869495.116746:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f3b80 x1875765325061504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869495.116754:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325061504:0@lo:400:kworker.0 00010000:00080000:3.0:1788869495.116764:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703954700 x1875765325060864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869495.116772:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325060864:0@lo:400:kworker.0 00010000:00080000:3.0:1788869495.116781:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f1500 x1875765325061376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869495.116798:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325061376:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.117771:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869495.117821:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325060608:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.117871:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869495.117891:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325061120:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.117928:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869495.117946:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325061632:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.117967:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869495.117990:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788869495.117997:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325060736:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.118020:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869495.118038:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325061248:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.118059:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869495.118103:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325060096 00000100:00100000:0.0:1788869495.118110:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325060096 00000100:00100000:0.0:1788869495.118156:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788869495.118164:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325060096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.118212:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325060096:12345-0@lo:400:kworker.0 Request processed in 50us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869495.118228:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788869495.118424:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325060608 00000100:00100000:0.0:1788869495.118429:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325060608 00000100:00100000:0.0:1788869495.118456:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788869495.118461:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325060608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.118713:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325060608:12345-0@lo:400:kworker.0 Request processed in 250us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869495.118720:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788869495.118740:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325061120 00000100:00100000:0.0:1788869495.118744:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325061120 00000100:00100000:0.0:1788869495.118774:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325061632 00000100:00100000:0.0:1788869495.118777:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325061632 00000100:00100000:0.0:1788869495.118799:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788869495.118805:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703babb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325061120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.118837:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703babb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325061120:12345-0@lo:400:kworker.0 Request processed in 33us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869495.118843:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788869495.118857:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788869495.118862:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325061632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.118886:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325061632:12345-0@lo:400:kworker.0 Request processed in 24us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869495.118891:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788869495.118924:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325060736 00000100:00100000:0.0:1788869495.118928:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325060736 00000100:00100000:0.0:1788869495.118951:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325061248 00000100:00100000:0.0:1788869495.118954:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325061248 00000100:00100000:0.0:1788869495.118973:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788869495.118985:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325060736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.119014:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325060736:12345-0@lo:400:kworker.0 Request processed in 30us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869495.119019:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788869495.119030:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788869495.119035:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325061248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.119060:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325061248:12345-0@lo:400:kworker.0 Request processed in 25us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869495.119065:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788869495.119213:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325060736:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.119225:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325061248:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.119235:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325060096:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.119243:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325060608:0@lo:400:kworker.0 00010000:00080000:0.0:1788869495.119253:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d7480 x1875765325061120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869495.119392:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325061120:0@lo:400:kworker.0 00010000:00080000:0.0:1788869495.119405:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f1c00 x1875765325061632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869495.119413:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325061632:0@lo:400:kworker.0 00000100:00080000:0.0:1788869495.119460:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869495.119465:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869495.119467:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869495.122823:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325060352:12345-0@lo:400:kworker.0 Request processed in 12237us (12628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869495.122842:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788869495.123662:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325060352:0@lo:400:kworker.0 00000100:00100000:1.0:1788869495.124550:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325060224:0@lo:400:kworker.0 00000100:00100000:0.0:1788869495.623509:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869495.623538:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325061760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869495.623673:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869495.623791:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325061760 00000100:00100000:1.0:1788869495.623800:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325061760 00000100:00100000:3.0:1788869495.623823:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869495.623833:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325061888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869495.623854:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869495.623865:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869495.623865:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325061760:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869495.623896:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325061888 00000100:00100000:3.0:1788869495.623900:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325061888 00002000:00000024:1.0:1788869495.623901:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869495.623919:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869495.623925:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325061888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869495.623945:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325061760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869495.623951:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00002000:00000024:3.0:1788869495.623952:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869495.623978:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325061888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869495.623984:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1788869495.624012:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0f1500 x1875765325061888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869495.624031:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325061888:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788869495.624170:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703bab100 x1875765325061760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869495.624184:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325061760:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869496.008512:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869497.033363:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869497.158328:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325062016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869497.158408:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869497.158489:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325062016 00000100:00100000:3.0:1788869497.158500:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325062016 00000100:00100000:3.0:1788869497.158550:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788869497.158560:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325062016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869497.158631:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869497.158702:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325062016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869497.158710:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788869497.158753:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325062016:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788869498.031928:0:13692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788869498.066268:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788869498.181934:0:8738:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432095342446ns, next at 433095338884ns, rc = 0 00000100:00100000:2.0:1788869498.181945:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325062144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869498.182029:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869498.182500:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325062144 00000100:00100000:1.0:1788869498.182509:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325062144 00000100:00100000:2.0:1788869498.182526:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869498.182539:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325062272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869498.182616:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788869498.182629:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325062144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869498.182779:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869498.182993:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325062272 00000100:00100000:3.0:1788869498.182998:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325062272 00000100:00100000:3.0:1788869498.183023:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788869498.183031:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325062272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869498.183052:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869498.183122:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325062272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869498.183129:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1788869498.183283:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f0ad80 x1875765325062272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869498.183305:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325062272:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869498.184615:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788869498.184781:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869498.184837:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325062144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2209us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869498.184854:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1788869498.184944:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703bab100 x1875765325062144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869498.184967:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325062144:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788869498.190497:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788869498.190828:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788869498.190844:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788869498.190859:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325062400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788869498.190944:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869498.191146:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325062400 00000100:00100000:0.0:1788869498.191157:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325062400 00000100:00100000:0.0:1788869498.191213:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869498.191225:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325062400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788869498.191259:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788869498.191300:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ffb73, atime: 0x6a9ffb73, ctime: 0x6a9ffb73, blocks: 0x0 00010000:00010000:2.0:1788869498.191527:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191543:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191552:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191559:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869498.191564:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191583:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.191628:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191631:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8e2701ecc300) 00010000:00010000:2.0:1788869498.191639:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869498.191647:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191654:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cea87 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.191659:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788869498.191666:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869498.191673:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.191674:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.191701:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191702:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191720:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191731:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869498.191736:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.191741:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191747:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.191751:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191762:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e2809bdcb00) 00010000:00010000:2.0:1788869498.191766:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869498.191770:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.191773:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869498.191777:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6cea9c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191797:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191803:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191808:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191814:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe1600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869498.191823:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191829:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191838:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8e2701ecc300) 00010000:00010000:2.0:1788869498.191841:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869498.191843:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191849:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1600/0x4c16c38a9b6ceb05 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191879:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191886:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191893:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191899:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869498.191902:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191908:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191916:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e2803b9b100) 00010000:00010000:2.0:1788869498.191919:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869498.191928:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869498.191935:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb21 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869498.191950:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765325062400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 725us (1004us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788869498.191960:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788869498.191994:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869498.192000:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.192008:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869498.192011:0:7475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.192019:0:7475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.192033:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.192040:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000073a16e0/0x4c16c38a9b6ceb2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869498.192063:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869498.192065:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869498.192067:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788869498.192286:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2840f08e00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788869498.192293:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325062400:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788869499.077842:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869499.210696:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325062528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869499.210813:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869499.211823:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325062528 00000100:00100000:3.0:1788869499.211839:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325062528 00000100:00100000:3.0:1788869499.211915:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788869499.211941:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325062528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869499.211988:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869499.212075:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325062528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869499.212082:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788869499.212258:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325062528:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1788869499.318300:0:13740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb0710730 20000000:00000080:3.0:1788869499.318325:0:13740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e27037b4c00 uarg=0000000000000000 20000000:01000000:3.0:1788869499.318378:0:13740:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788869499.318386:0:13740:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788869499.318391:0:13740:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788869499.324782:0:13741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:3.0:1788869499.326498:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869499.326559:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 20000000:02000000:2.0:1788869499.326565:0:13740:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000100:00100000:0.0:1788869499.326690:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305044864 00000100:00100000:0.0:1788869499.326704:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305044864 00000100:00100000:0.0:1788869499.326781:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:0.0:1788869499.326794:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305044864:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869499.326886:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305044864:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 95us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869499.326894:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00080000:0.0:1788869499.326918:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869499.327209:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869499.327247:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869499.327319:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869499.327344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869499.327363:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305044736 00000100:00100000:3.0:1788869499.327368:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305044736 00000100:00100000:3.0:1788869499.327398:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 346 00000100:00100000:3.0:1788869499.327405:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2407:x1875765305044736:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869499.327440:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2407:x1875765305044736:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869499.327447:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 346 00000100:00100000:3.0:1788869499.327477:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305045376 00000100:00100000:3.0:1788869499.327481:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305045376 00000100:00100000:3.0:1788869499.327508:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305044992 00000100:00100000:3.0:1788869499.327511:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305044992 00000100:00100000:3.0:1788869499.327526:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305045248 00000100:00100000:3.0:1788869499.327528:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305045248 00000100:00100000:3.0:1788869499.327557:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00100000:3.0:1788869499.327565:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305045376:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869499.327608:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305045376:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 44us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869499.327615:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00100000:3.0:1788869499.327628:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 256 00000100:00100000:3.0:1788869499.327634:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305044992:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869499.327678:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305044992:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 45us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869499.327685:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 256 00000100:00100000:3.0:1788869499.327697:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 257 00000100:00100000:3.0:1788869499.327703:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305045248:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869499.327727:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305045248:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869499.327733:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 257 00000100:00080000:3.0:1788869499.327830:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869499.327834:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869499.330275:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305045120 00000100:00100000:1.0:1788869499.330293:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305045120 00000100:00100000:1.0:1788869499.330387:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:1.0:1788869499.330398:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305045120:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869499.330486:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305045120:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 90us (3926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869499.330494:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00080000:3.0:1788869499.332286:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788869499.345565:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788869499.345652:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788869499.345683:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788869499.345705:0:13740:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788869499.345729:0:13740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.345751:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9bc expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.345759:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9ca expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.345767:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9d8 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.345773:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ce9e6 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.345782:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d1e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.345790:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d25 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.345820:0:13740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.345871:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d25 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.345886:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d25 expref: 12 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.345902:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325062656:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869499.346013:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d1e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.346022:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d1e expref: 12 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.346030:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325062784:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869499.346061:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce9e6 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.346070:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9e6 expref: 23 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.346078:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325062912:0@lo:104: 00000100:00100000:2.0:1788869499.346140:0:13740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869499.346173:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce9d8 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.346193:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9d8 expref: 23 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.346202:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325063040:0@lo:104: 00010000:00010000:2.0:1788869499.346231:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce9ca expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.346239:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9ca expref: 23 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.346247:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325063168:0@lo:104: 00010000:00010000:2.0:1788869499.346291:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6ce9bc expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.346299:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9bc expref: 23 pid: 6518 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.346307:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325063296:0@lo:104: 00000100:00100000:2.0:1788869499.346326:0:13740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840c52cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869499.348308:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788869499.348354:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869499.348511:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869499.348526:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869499.348538:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325062912 00000100:00100000:2.0:1788869499.348561:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325062912 00000100:00100000:3.0:1788869499.348617:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325063040 00000100:00100000:3.0:1788869499.348622:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325063040 00000100:00100000:2.0:1788869499.348632:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325063168 00000100:00100000:2.0:1788869499.348635:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325063168 00000100:00100000:3.0:1788869499.348639:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325063296 00000100:00100000:3.0:1788869499.348641:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325063296 00000100:00100000:2.0:1788869499.350886:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869499.355072:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:13740:x1875765325062912:12345-0@lo:104: 00010000:00010000:0.0:1788869499.355100:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.355120:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325062656:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869499.355161:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325062784:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869499.355173:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325062912:0@lo:104: 00010000:00010000:0.0:1788869499.355198:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869499.355206:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+6:13740:x1875765325062912:12345-0@lo:104: Request processed in 4303us (9066us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869499.355254:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869499.355264:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.355272:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869499.355276:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.355284:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869499.355304:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869499.355310:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869499.355361:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.355367:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869499.355394:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.355400:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6ce9e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.355415:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869499.355417:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869499.355419:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869499.355434:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325063424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869499.355476:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869499.360143:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869499.360231:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869499.360256:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325063424 00000100:00100000:1.0:1788869499.360265:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325063424 00000100:00100000:3.0:1788869499.360285:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305045504 00000100:00100000:3.0:1788869499.360290:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305045504 00010000:00010000:3.0:1788869499.360308:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d25 expref: 13 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.360308:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9e6 expref: 24 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869499.360334:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305045632 00000100:00100000:3.0:1788869499.360337:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305045632 00010000:00010000:3.0:1788869499.360350:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d1e expref: 14 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869499.360408:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869499.360478:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869499.360492:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:13740:x1875765325063040:12345-0@lo:104: 00010000:00010000:0.0:1788869499.360508:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360623:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869499.360646:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+5:13740:x1875765325063040:12345-0@lo:104: Request processed in 159us (12293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869499.360653:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869499.360670:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869499.360676:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:13740:x1875765325063168:12345-0@lo:104: 00010000:00010000:0.0:1788869499.360686:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360724:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788869499.360729:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+4:13740:x1875765325063168:12345-0@lo:104: Request processed in 53us (12218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869499.360734:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869499.360748:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788869499.360754:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:13740:x1875765325063296:12345-0@lo:104: 00010000:00010000:0.0:1788869499.360762:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360795:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788869499.360800:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+3:13740:x1875765325063296:12345-0@lo:104: Request processed in 47us (12274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869499.360806:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788869499.360823:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869499.360829:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360836:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4c00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869499.360840:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360861:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869499.360869:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869499.360875:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788869499.360910:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360917:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869499.360953:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360961:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4c00/0x4c16c38a9b6ce9d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360973:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869499.360976:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360982:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869499.360985:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.360991:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869499.360998:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869499.361010:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788869499.361024:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.361031:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869499.361048:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.361055:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5200/0x4c16c38a9b6ce9ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.361062:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869499.361065:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.361070:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5800 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869499.361073:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.361080:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869499.361086:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869499.361091:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788869499.361105:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.361392:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869499.361407:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.361415:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5800/0x4c16c38a9b6ce9bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6ce9c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869499.361430:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869499.361432:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869499.361434:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869499.361443:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869499.361449:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869499.361468:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325063552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869499.361520:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869499.372766:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325063552 00000100:00100000:1.0:1788869499.372782:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325063552 00010000:00010000:1.0:1788869499.372833:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9d8 expref: 25 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869499.372847:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325063680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869499.372883:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788869499.372891:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:448e652b-ca43-4915-9c32-5166fb543df5+14:2410:x1875765305045504:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869499.372905:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788869499.372910:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869499.372912:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d25 expref: 14 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869499.372923:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788869499.372925:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d25 expref: 14 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.372945:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe1000/0x4c16c38a9b6ce9fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d25 expref: 14 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.372962:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869499.373015:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305045504:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 124us (12893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869499.373023:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788869499.373038:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325063808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869499.373041:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325063680 00000100:00100000:1.0:1788869499.373044:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325063680 00010000:00010000:1.0:1788869499.373056:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9ca expref: 26 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869499.373062:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869499.373067:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325063808 00000100:00100000:1.0:1788869499.373070:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325063808 00010000:00010000:1.0:1788869499.373080:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9bc expref: 27 pid: 6518 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869499.373091:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869499.373098:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+27:3648:x1875765325063424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869499.373113:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869499.373118:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9e6 expref: 27 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.375266:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9e6 expref: 27 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.375291:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6ce9ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9e6 expref: 27 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.375306:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869499.375410:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+26:3648:x1875765325063424:12345-0@lo:103:ldlm_bl.0 Request processed in 2310us (19931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869499.375422:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869499.375761:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325063424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869499.376276:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1788869499.376297:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+12:2409:x1875765305045632:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869499.376320:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869499.376330:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d1e expref: 12 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.376346:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d1e expref: 12 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.376361:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6ce9f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d1e expref: 12 pid: 6516 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.376376:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869499.376426:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+11:2409:x1875765305045632:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 141us (16195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869499.376433:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1788869499.376451:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869499.376458:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+25:3649:x1875765325063552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869499.376467:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869499.376472:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9d8 expref: 25 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.376482:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9d8 expref: 25 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.376514:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869499.376581:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+25:3649:x1875765325063552:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (15060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869499.376604:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869499.377495:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325063552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869499.377777:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788869499.377793:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325063680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869499.377808:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869499.377815:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9ca expref: 24 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.377829:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9ca expref: 24 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.377845:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869499.377903:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325063680:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (4992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869499.377910:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788869499.377937:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869499.377944:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:3650:x1875765325063808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869499.377965:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869499.377970:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9bc expref: 23 pid: 6518 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.377979:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9bc expref: 23 pid: 6518 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.377991:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.378001:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.378020:0:10401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869499.378027:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325063680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869499.378028:0:10401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.378036:0:10401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.378043:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.378050:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869499.378054:0:10401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.378063:0:10401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.378084:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869499.378095:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869499.378249:0:13740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6ce9df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9d8 expref: 23 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.378261:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325063040:0@lo:104: 00010000:00010000:2.0:1788869499.378271:0:13740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe0000/0x4c16c38a9b6ce9d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9ca expref: 22 pid: 6516 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.378278:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325063168:0@lo:104: 00010000:00010000:2.0:1788869499.378287:0:13740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7ea00/0x4c16c38a9b6ce9c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6ce9bc expref: 21 pid: 6518 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869499.378295:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875765325063296:0@lo:104: 00010000:00010000:2.0:1788869499.378320:0:13740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.378330:0:13740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.378336:0:13740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869499.378342:0:13740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6ceb36 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869499.379483:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3650:x1875765325063808:12345-0@lo:103:ldlm_bl.0 Request processed in 1533us (6414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869499.379496:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788869499.382130:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325063808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869500.102712:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869500.230845:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325064064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.230919:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.230977:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325064576:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231015:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231050:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325065088:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231072:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231097:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788869500.231102:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325063936:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231129:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231151:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325064448:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231175:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231191:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325064960:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231213:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231229:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325065472:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231249:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231275:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325064192:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231297:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231313:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325064704:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231333:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231350:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325065216:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231369:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231381:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788869500.231386:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325064320:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231405:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231415:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325064832:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231433:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231448:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325065344:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231478:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.231508:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325064064 00000100:00100000:3.0:1788869500.231517:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325064064 00000100:00100000:3.0:1788869500.231566:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325064576 00000100:00100000:3.0:1788869500.231570:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325064576 00000100:00100000:3.0:1788869500.231615:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325065088 00000100:00100000:3.0:1788869500.231618:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325065088 00000100:00100000:3.0:1788869500.231631:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325064704 00000100:00100000:3.0:1788869500.231634:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325064704 00000100:00100000:3.0:1788869500.231645:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325065216 00000100:00100000:3.0:1788869500.231648:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325065216 00000100:00100000:3.0:1788869500.231657:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325064320 00000100:00100000:3.0:1788869500.231659:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325064320 00000100:00100000:3.0:1788869500.231670:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788869500.231678:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325064064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231731:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325064064:12345-0@lo:400:kworker.0 Request processed in 53us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.231738:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788869500.231755:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788869500.231761:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325064576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231787:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325064576:12345-0@lo:400:kworker.0 Request processed in 27us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.231792:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788869500.231802:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788869500.231808:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325065088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231832:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325065088:12345-0@lo:400:kworker.0 Request processed in 25us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.231838:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788869500.231858:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788869500.231864:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325064704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231897:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325064704:12345-0@lo:400:kworker.0 Request processed in 33us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.231902:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788869500.231913:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788869500.231918:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325065216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231943:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325065216:12345-0@lo:400:kworker.0 Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.231948:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788869500.231959:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788869500.231964:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325064320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.231987:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325064320:12345-0@lo:400:kworker.0 Request processed in 23us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.231993:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788869500.232016:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325063936 00000100:00100000:3.0:1788869500.232019:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325063936 00000100:00100000:3.0:1788869500.232043:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788869500.232049:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3649:x1875765325063936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232075:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3649:x1875765325063936:12345-0@lo:400:kworker.0 Request processed in 27us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.232081:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788869500.232105:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325064448 00000100:00100000:3.0:1788869500.232109:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325064448 00000100:00100000:3.0:1788869500.232130:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325064192 00000100:00100000:3.0:1788869500.232132:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325064192 00000100:00100000:3.0:1788869500.232152:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788869500.232158:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325064448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232186:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325064448:12345-0@lo:400:kworker.0 Request processed in 28us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.232191:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788869500.232202:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788869500.232207:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325064192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232230:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325064192:12345-0@lo:400:kworker.0 Request processed in 23us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.232236:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788869500.232251:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325064960 00000100:00100000:3.0:1788869500.232254:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325064960 00000100:00100000:3.0:1788869500.232285:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325065472 00000100:00100000:3.0:1788869500.232288:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325065472 00000100:00100000:3.0:1788869500.232301:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325064832 00000100:00100000:3.0:1788869500.232303:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325064832 00000100:00100000:3.0:1788869500.232314:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325065344 00000100:00100000:3.0:1788869500.232317:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325065344 00000100:00100000:3.0:1788869500.232329:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788869500.232335:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875765325064960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232363:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875765325064960:12345-0@lo:400:kworker.0 Request processed in 29us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.232369:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788869500.232379:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788869500.232385:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325065472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232409:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325065472:12345-0@lo:400:kworker.0 Request processed in 24us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.232424:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788869500.232434:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788869500.232439:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325064832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232466:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325064832:12345-0@lo:400:kworker.0 Request processed in 27us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.232471:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788869500.232481:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788869500.232486:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325065344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232510:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325065344:12345-0@lo:400:kworker.0 Request processed in 24us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.232515:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788869500.232551:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869500.232555:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869500.232557:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869500.232559:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869500.232615:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325064320:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232629:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325064832:0@lo:400:kworker.0 00010000:00080000:3.0:1788869500.232640:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f14380 x1875765325065344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869500.232650:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325065344:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232661:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325064192:0@lo:400:kworker.0 00010000:00080000:3.0:1788869500.232670:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703956d80 x1875765325064704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869500.232678:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325064704:0@lo:400:kworker.0 00010000:00080000:3.0:1788869500.232697:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f16a00 x1875765325065216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869500.232705:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325065216:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232745:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325063936:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232755:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325064448:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232764:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325064960:0@lo:400:kworker.0 00010000:00080000:3.0:1788869500.232774:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f17480 x1875765325065472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869500.232782:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325065472:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232792:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325064064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232800:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325064576:0@lo:400:kworker.0 00000100:00100000:3.0:1788869500.232810:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325065088:0@lo:400:kworker.0 00000020:00000080:1.0:1788869500.246312:0:13789:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcbb64e10 20000000:00000080:1.0:1788869500.246329:0:13789:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2703bd6000 uarg=0000000000000000 20000000:01000000:1.0:1788869500.246371:0:13789:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788869500.246377:0:13789:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788869500.246382:0:13789:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788869500.247504:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788869500.247998:0:13789:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788869500.248265:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788869500.248301:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788869500.248318:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788869500.248343:0:13789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788869500.248365:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248382:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248393:0:13789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248400:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248407:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248422:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248429:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869500.248433:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248442:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248456:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248464:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869500.248471:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7f000/0x4c16c38a9b6ceb3d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869500.601900:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869500.602003:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305045760 00000100:00100000:3.0:1788869500.602018:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305045760 00000100:00100000:3.0:1788869500.602091:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 348 00000100:00100000:3.0:1788869500.602115:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+11:6181:x1875765305045760:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869500.602134:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869500.602156:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe1600/0x4c16c38a9b6ceb44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d72 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869500.602186:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe1600/0x4c16c38a9b6ceb44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d72 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869500.602215:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe1600/0x4c16c38a9b6ceb44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d72 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869500.602225:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe1600, rc 0) 00000100:00100000:3.0:1788869500.602298:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305045760:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 185us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.602305:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 348 00000100:00100000:3.0:1788869500.605514:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869500.605646:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305045888 00000100:00100000:0.0:1788869500.605659:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305045888 00000100:00100000:0.0:1788869500.605724:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 349 00000100:00100000:0.0:1788869500.605750:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305045888:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869500.605931:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305045888:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 183us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869500.605940:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 349 00000100:00100000:1.0:1788869500.620947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869500.621214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305046016 00000100:00100000:0.0:1788869500.621225:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305046016 00000100:00100000:0.0:1788869500.621321:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 350 00000100:00100000:0.0:1788869500.621332:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305046016:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869500.621491:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305046016:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 161us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869500.621499:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 350 00000100:00100000:1.0:1788869500.634382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869500.634749:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305046144 00000100:00100000:3.0:1788869500.634760:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305046144 00000100:00100000:3.0:1788869500.634829:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 351 00000100:00100000:3.0:1788869500.634840:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+12:10812:x1875765305046144:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869500.635020:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+12:10812:x1875765305046144:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 182us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.635029:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 351 00000100:00100000:1.0:1788869500.639735:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869500.639844:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305046272 00000100:00100000:0.0:1788869500.639857:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305046272 00000100:00100000:0.0:1788869500.639920:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 352 00000100:00100000:0.0:1788869500.639932:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+12:10812:x1875765305046272:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869500.640112:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+12:10812:x1875765305046272:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 176us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869500.640120:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 352 00000100:00100000:1.0:1788869500.659370:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869500.659781:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305046400 00000100:00100000:0.0:1788869500.659792:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305046400 00000100:00100000:0.0:1788869500.659854:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 353 00000100:00100000:0.0:1788869500.659866:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+12:6181:x1875765305046400:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869500.659885:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869500.659904:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6ceb4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d79 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869500.659968:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6ceb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d79 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869500.659982:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6ceb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d79 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869500.659992:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5400, rc 0) 00000100:00100000:0.0:1788869500.660058:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305046400:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 194us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869500.660065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 353 00000100:00100000:1.0:1788869500.681847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869500.681940:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305046528 00000100:00100000:3.0:1788869500.681951:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305046528 00000100:00100000:3.0:1788869500.682016:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 354 00000100:00100000:3.0:1788869500.682027:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305046528:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869500.682202:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305046528:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 176us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.682210:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 354 00000100:00100000:1.0:1788869500.692453:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869500.692618:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305046656 00000100:00100000:3.0:1788869500.692630:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305046656 00000100:00100000:3.0:1788869500.692690:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 355 00000100:00100000:3.0:1788869500.692717:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305046656:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869500.692910:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:6181:x1875765305046656:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 194us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.692918:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 355 00000100:00100000:1.0:1788869500.705783:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869500.705894:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305046784 00000100:00100000:0.0:1788869500.705905:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305046784 00000100:00100000:0.0:1788869500.705978:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 356 00000100:00100000:0.0:1788869500.705990:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:10816:x1875765305046784:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869500.706187:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:10816:x1875765305046784:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 197us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869500.706196:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 356 00000100:00100000:1.0:1788869500.712932:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869500.713224:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305046912 00000100:00100000:0.0:1788869500.713240:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305046912 00000100:00100000:0.0:1788869500.713316:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 357 00000100:00100000:0.0:1788869500.713327:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:10816:x1875765305046912:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869500.713506:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:10816:x1875765305046912:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 180us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869500.713515:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 357 00000100:00100000:1.0:1788869500.742301:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869500.742344:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325065600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869500.742451:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869500.742885:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325065600 00000100:00100000:3.0:1788869500.742898:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325065600 00000100:00100000:3.0:1788869500.742957:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869500.742977:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325065600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869500.743009:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869500.746186:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325065600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3198us (3721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869500.746203:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869500.746251:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325065728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869500.746320:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869500.746866:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325065728 00000100:00100000:1.0:1788869500.746877:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325065728 00000100:00100000:1.0:1788869500.746936:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788869500.746945:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325065728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869500.746981:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869500.747035:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325065728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869500.747041:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1788869500.747328:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283b473b80 x1875765325065728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869500.747362:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325065728:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788869500.750141:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703913800 x1875765325065600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869500.750194:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325065600:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788869501.064121:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869501.064132:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e27029d7800 from 7 10000000:01000000:0.0:1788869501.064138:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869501.064193:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.064207:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.064219:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.064249:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325065856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869501.064329:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869501.064407:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.065474:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325065856 00000100:00100000:3.0:1788869501.065485:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325065856 00000100:00100000:3.0:1788869501.065559:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788869501.065568:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:6521:x1875765325065856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869501.065582:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869501.065626:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ceb52 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.065652:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb52 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.065663:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb52 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.065691:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe0a00, rc 0) 00000100:00100000:3.0:1788869501.065776:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325065856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.065782:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788869501.065942:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325065856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869501.065959:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.065969:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.066041:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325065984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.066075:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.066175:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.066247:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325065984 00000100:00100000:3.0:1788869501.066253:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325065984 00000100:00100000:3.0:1788869501.066286:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788869501.066293:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325065984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869501.066398:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325065984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.066405:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788869501.066431:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325065984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.066457:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325066112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.066501:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.066574:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.066579:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325066112 00000100:00100000:0.0:1788869501.066584:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325066112 00000100:00100000:0.0:1788869501.066632:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788869501.066641:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325066112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869501.066735:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325066112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.066742:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788869501.066802:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325066112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.067401:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13803:1875765325066240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869501.067441:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.067471:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.067541:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325066240 00000100:00100000:3.0:1788869501.067547:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325066240 00000100:00100000:3.0:1788869501.067630:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788869501.067635:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:13803:x1875765325066240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869501.067708:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:13803:x1875765325066240:12345-0@lo:502:llog_process_th.0 Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.067715:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788869501.067795:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13803:1875765325066240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869501.067817:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869501.067827:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869501.067830:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869501.067846:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e27029d7800 00000020:00000080:2.0:1788869501.067853:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869501.067924:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869501.067929:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869501.067930:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869501.067933:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869501.067936:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869501.067937:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788869501.067941:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e27029d7800 00000020:00000080:2.0:1788869501.067942:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788869501.068775:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13803:1875765325066368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869501.068822:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.068847:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.070576:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325066368 00000100:00100000:3.0:1788869501.070611:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325066368 00000100:00100000:3.0:1788869501.070664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788869501.070675:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:13803:x1875765325066368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869501.070852:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:13803:x1875765325066368:12345-0@lo:502:llog_process_th.0 Request processed in 178us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.070860:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788869501.070901:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13803:1875765325066368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869501.071009:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869501.071017:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.071019:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788869501.071027:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788869501.071208:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788869501.071231:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869501.071240:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.071253:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869501.071331:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869501.071335:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e283b46c800 from 7 10000000:01000000:3.0:1788869501.071338:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869501.071437:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.071446:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.071456:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.071481:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325066496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869501.071544:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.071618:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.071851:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325066496 00000100:00100000:0.0:1788869501.071857:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325066496 00000100:00100000:0.0:1788869501.071891:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788869501.071899:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:6521:x1875765325066496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869501.071918:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869501.071931:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6ceb67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ceb60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.071955:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6ceb67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb60 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.072066:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6ceb67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb60 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.072077:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4200, rc 0) 00000100:00100000:0.0:1788869501.072119:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325066496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.072234:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325066496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869501.072252:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.072332:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.072473:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325066624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869501.072503:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.072552:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996000 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.072696:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325066624 00000100:00100000:1.0:1788869501.072702:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325066624 00000100:00100000:1.0:1788869501.072736:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788869501.072744:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325066624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869501.072850:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325066624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.072858:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788869501.073022:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325066624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869501.073051:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325066752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869501.073092:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.073117:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.073131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325066752 00000100:00100000:3.0:1788869501.073135:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325066752 00000100:00100000:3.0:1788869501.073154:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788869501.073159:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325066752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869501.073235:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325066752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.073242:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788869501.073250:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788869501.074046:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325066752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869501.074724:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13805:1875765325066880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869501.074778:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.074816:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.074864:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325066880 00000100:00100000:0.0:1788869501.074870:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325066880 00000100:00100000:0.0:1788869501.074909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788869501.074927:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:13805:x1875765325066880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869501.075036:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:13805:x1875765325066880:12345-0@lo:502:llog_process_th.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.075044:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788869501.075703:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13805:1875765325066880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869501.075737:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869501.075748:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.075751:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869501.075763:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e283b46c800 00000020:00000080:1.0:1788869501.075774:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869501.075859:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869501.075863:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.075865:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869501.075869:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869501.075873:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.075874:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788869501.075879:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e283b46c800 00000020:00000080:1.0:1788869501.075882:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869501.075943:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13805:1875765325067008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869501.075992:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869501.076022:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325067008 00000100:00100000:1.0:1788869501.076027:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325067008 00000100:00100000:1.0:1788869501.076061:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788869501.076070:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:13805:x1875765325067008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869501.076153:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:13805:x1875765325067008:12345-0@lo:502:llog_process_th.0 Request processed in 84us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.076161:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788869501.076201:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840c52c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.076213:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13805:1875765325067008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869501.076229:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869501.076233:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.076234:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788869501.076239:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788869501.079471:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788869501.079519:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869501.079531:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.079545:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869501.079557:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869501.079559:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282daf5000 from 7 10000000:01000000:2.0:1788869501.079562:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869501.079627:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.079636:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.079650:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.079688:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.079765:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.079807:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.081069:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325067136 00000100:00100000:3.0:1788869501.081079:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325067136 00000100:00100000:3.0:1788869501.081124:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788869501.081133:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:6521:x1875765325067136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869501.081146:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869501.081167:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ceb6e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.081191:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb6e expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.081203:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb6e expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.081211:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe1c00, rc 0) 00000100:00100000:3.0:1788869501.081282:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325067136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.081289:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788869501.081474:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869501.081492:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.081502:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.081612:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.081648:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.081680:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.082997:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325067264 00000100:00100000:1.0:1788869501.083015:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325067264 00000100:00100000:1.0:1788869501.083082:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788869501.083095:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325067264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869501.083288:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325067264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.083295:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788869501.083538:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.083604:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.083653:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.083686:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.083771:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325067392 00000100:00100000:1.0:1788869501.083776:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325067392 00000100:00100000:1.0:1788869501.083807:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788869501.083814:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325067392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869501.083892:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325067392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.083899:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788869501.083944:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869501.085753:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13807:1875765325067520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869501.085830:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869501.085877:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869501.086189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325067520 00000100:00100000:2.0:1788869501.086199:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325067520 00000100:00100000:2.0:1788869501.086256:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788869501.086266:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:13807:x1875765325067520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869501.086408:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:13807:x1875765325067520:12345-0@lo:502:llog_process_th.0 Request processed in 143us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.086416:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788869501.086768:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13807:1875765325067520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869501.086794:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869501.086804:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.086807:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869501.086817:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e282daf5000 00000020:00000080:1.0:1788869501.086820:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869501.086888:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000040:00080000:2.0:1788869501.087021:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1788869501.087113:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.087116:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869501.087121:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869501.087124:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.087126:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788869501.087130:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e282daf5000 00000020:00000080:1.0:1788869501.087133:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869501.088742:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13807:1875765325067648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869501.088830:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869501.088880:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325067648 00000100:00100000:1.0:1788869501.088888:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325067648 00000100:00100000:1.0:1788869501.088937:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788869501.088946:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:13807:x1875765325067648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869501.089056:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:13807:x1875765325067648:12345-0@lo:502:llog_process_th.0 Request processed in 111us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.089064:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788869501.089121:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2807c2e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.089140:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13807:1875765325067648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869501.089164:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869501.089171:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.089173:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788869501.089181:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788869501.090059:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788869501.090089:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869501.090102:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.090116:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869501.090128:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869501.090131:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e281757b800 from 7 10000000:01000000:3.0:1788869501.090133:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869501.090166:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.090174:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.090183:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.090209:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869501.090255:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.090745:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27029969c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.096351:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325067776 00000100:00100000:0.0:1788869501.096444:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325067776 00000100:00100000:0.0:1788869501.096521:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788869501.096532:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:6521:x1875765325067776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869501.096556:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869501.096576:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb4c00/0x4c16c38a9b6ceb83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6ceb7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.096620:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb4c00/0x4c16c38a9b6ceb83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb7c expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.096632:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb4c00/0x4c16c38a9b6ceb83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb7c expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.096641:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4c00, rc 0) 00000100:00100000:0.0:1788869501.096731:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325067776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (6475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.096738:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788869501.097085:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869501.097105:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.097114:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.097191:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.097229:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.099997:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.101414:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325067904 00000100:00100000:1.0:1788869501.101427:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325067904 00000100:00100000:1.0:1788869501.101497:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788869501.101506:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325067904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869501.102048:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325067904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 541us (4815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.102056:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788869501.102476:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325067904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.102543:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325068032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.102678:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.102714:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.102865:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325068032 00000100:00100000:0.0:1788869501.102872:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325068032 00000100:00100000:0.0:1788869501.102949:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788869501.102959:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325068032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869501.103061:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:6521:x1875765325068032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.103067:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788869501.103139:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:6521:1875765325068032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869501.103895:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13810:1875765325068160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869501.103944:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.104005:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a49c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.104038:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325068160 00000100:00100000:1.0:1788869501.104044:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325068160 00000100:00100000:1.0:1788869501.104180:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788869501.104189:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:13810:x1875765325068160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869501.104309:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:13810:x1875765325068160:12345-0@lo:502:llog_process_th.0 Request processed in 119us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.104316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788869501.104908:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13810:1875765325068160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869501.104938:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869501.104959:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869501.104962:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869501.104972:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e281757b800 00000020:00000080:2.0:1788869501.104975:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869501.105053:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869501.105058:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869501.105059:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869501.105062:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869501.105065:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869501.105066:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788869501.105069:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e281757b800 00000020:00000080:2.0:1788869501.105071:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788869501.105423:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13810:1875765325068288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869501.105480:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.106365:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.106442:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325068288 00000100:00100000:0.0:1788869501.106450:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325068288 00000100:00100000:0.0:1788869501.106503:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788869501.106526:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:13810:x1875765325068288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869501.106689:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:13810:x1875765325068288:12345-0@lo:502:llog_process_th.0 Request processed in 178us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.106722:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788869501.107034:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:13810:1875765325068288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869501.107065:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869501.107073:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869501.107075:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788869501.107082:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788869501.107340:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788869501.107362:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869501.107371:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.107382:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869501.107770:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788869501.129969:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869502.149846:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869502.150686:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788869502.157021:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869502.277918:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325068416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869502.278010:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869502.278225:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325068416 00000100:00100000:3.0:1788869502.278237:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325068416 00000100:00100000:3.0:1788869502.278297:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788869502.278306:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325068416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869502.278342:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869502.278395:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325068416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869502.278401:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788869502.278444:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325068416:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788869503.176861:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869503.303909:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869503.303947:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325068544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869503.304049:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.304307:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325068544 00000100:00100000:1.0:1788869503.304318:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325068544 00000100:00100000:1.0:1788869503.304387:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788869503.304398:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325068544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869503.304436:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869503.304499:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325068544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.304506:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788869503.304884:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869503.304935:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325068544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869503.305389:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869503.305401:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325068672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869503.305442:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.306302:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325068672 00000100:00100000:1.0:1788869503.306311:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325068672 00000100:00100000:1.0:1788869503.306385:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788869503.306394:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325068672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869503.306414:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869503.306489:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325068672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.306497:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788869503.306654:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325068672:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869503.307081:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788869503.815663:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1788869504.199422:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869504.325996:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325068800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869504.326083:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869504.327918:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325068800 00000100:00100000:2.0:1788869504.327935:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325068800 00000100:00100000:2.0:1788869504.328020:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788869504.328045:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325068800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869504.328119:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869504.328220:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325068800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 179us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869504.328228:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788869504.329082:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325068800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869504.441746:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869504.441884:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305047168 00000100:00100000:3.0:1788869504.441895:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305047168 00000100:00100000:3.0:1788869504.441985:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 264 00000100:00100000:3.0:1788869504.441997:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305047168:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869504.442095:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305047168:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869504.442102:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 264 00000100:00080000:1.0:1788869504.442482:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869504.447045:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869504.447084:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869504.447319:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305047680 00000100:00100000:0.0:1788869504.447331:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305047680 00000100:00100000:0.0:1788869504.447414:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 265 00000100:00100000:0.0:1788869504.447428:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305047680:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:2.0:1788869504.447528:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869504.447627:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305047424 00000100:00100000:3.0:1788869504.447650:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305047424 00000100:00100000:3.0:1788869504.447703:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:3.0:1788869504.447712:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305047424:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:2.0:1788869504.447770:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869504.455684:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305047680:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 8242us (8581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869504.455712:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 265 00000100:00100000:1.0:1788869504.455890:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869504.456127:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305047040 00000100:00100000:0.0:1788869504.456142:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305047040 00000100:00100000:0.0:1788869504.459176:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 378 00000100:00100000:0.0:1788869504.459222:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2409:x1875765305047040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869504.465939:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2409:x1875765305047040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 6733us (10035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869504.465957:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 378 00000100:00100000:3.0:1788869504.466276:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305047424:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 18563us (19251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869504.466287:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:2.0:1788869504.466609:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869504.466789:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305047296 00000100:00100000:3.0:1788869504.466801:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305047296 00000100:00100000:3.0:1788869504.466870:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 266 00000100:00100000:3.0:1788869504.466881:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305047296:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869504.467070:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305047296:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 191us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869504.467078:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 266 00000100:00080000:3.0:1788869504.467113:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869504.467411:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869504.467556:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305047552 00000100:00100000:3.0:1788869504.467562:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305047552 00000100:00100000:3.0:1788869504.467624:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 267 00000100:00100000:3.0:1788869504.467631:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305047552:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869504.467661:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305047552:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869504.467667:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 267 00000100:00080000:0.0:1788869504.467755:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788869505.221856:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869505.353280:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325069312:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.353366:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.353439:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325069824:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.353495:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.353518:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325070336:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.353539:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.353565:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788869505.353571:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325068928:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.353643:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.353673:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325069440:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.353696:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.353715:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325069952:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.353735:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.353751:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325070464:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.353772:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.353804:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325069312 00000100:00100000:1.0:1788869505.353812:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325069312 00000100:00100000:1.0:1788869505.353864:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788869505.353874:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325069312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.353940:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325069312:12345-0@lo:400:kworker.0 Request processed in 54us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.353948:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788869505.354001:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325069824 00000100:00100000:1.0:1788869505.354006:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325069824 00000100:00100000:1.0:1788869505.354040:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325070336 00000100:00100000:1.0:1788869505.354042:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325070336 00000100:00100000:1.0:1788869505.354053:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325069952 00000100:00100000:1.0:1788869505.354055:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325069952 00000100:00100000:1.0:1788869505.354066:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325070464 00000100:00100000:1.0:1788869505.354068:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325070464 00000100:00100000:1.0:1788869505.354080:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788869505.354087:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325069824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354121:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325069824:12345-0@lo:400:kworker.0 Request processed in 34us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.354127:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788869505.354139:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788869505.354144:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325070336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354187:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325070336:12345-0@lo:400:kworker.0 Request processed in 42us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.354193:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788869505.354207:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788869505.354213:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325069952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354240:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325069952:12345-0@lo:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.354245:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788869505.354257:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788869505.354262:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325070464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354288:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325070464:12345-0@lo:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.354302:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788869505.354328:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325069440 00000100:00100000:1.0:1788869505.354332:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325069440 00000100:00100000:1.0:1788869505.354355:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788869505.354361:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325069440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354392:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325069440:12345-0@lo:400:kworker.0 Request processed in 32us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.354398:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788869505.354422:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869505.354426:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869505.354471:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325069440:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354481:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788869505.354487:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2840f08e00, transno 4294967301 00000100:00100000:1.0:1788869505.354497:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325069952:0@lo:400:kworker.0 00010000:00080000:1.0:1788869505.354510:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270402ca80 x1875765325070464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869505.354520:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325070464:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354530:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325069312:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354540:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325069824:0@lo:400:kworker.0 00010000:00080000:1.0:1788869505.354548:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270402c000 x1875765325070336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869505.354555:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325070336:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354736:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325069056:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354777:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.354800:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325069568:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354821:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.354837:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325070080:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354856:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.354875:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869505.354881:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325069184:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354903:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.354922:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325069696:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354941:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.354951:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325070208:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.354969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.354988:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325069056 00000100:00100000:1.0:1788869505.354993:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325069056 00000100:00100000:1.0:1788869505.355011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325069568 00000100:00100000:1.0:1788869505.355014:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325069568 00000100:00100000:1.0:1788869505.355031:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325070080 00000100:00100000:1.0:1788869505.355034:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325070080 00000100:00100000:1.0:1788869505.355045:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325069696 00000100:00100000:1.0:1788869505.355048:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325069696 00000100:00100000:1.0:1788869505.355057:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325070208 00000100:00100000:1.0:1788869505.355059:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325070208 00000100:00100000:1.0:1788869505.355073:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788869505.355078:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325069056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355113:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325069056:12345-0@lo:400:kworker.0 Request processed in 34us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.355119:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788869505.355141:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788869505.355147:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325069568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355174:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325069568:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.355180:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788869505.355193:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788869505.355198:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325070080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355224:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325070080:12345-0@lo:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.355230:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788869505.355242:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788869505.355248:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325069696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355274:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325069696:12345-0@lo:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.355280:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788869505.355293:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788869505.355298:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325070208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355323:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325070208:12345-0@lo:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.355328:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:1.0:1788869505.355344:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869505.355347:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788869505.355366:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270402c700 x1875765325069696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869505.355377:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325069696:0@lo:400:kworker.0 00010000:00080000:1.0:1788869505.355400:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270402dc00 x1875765325070208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869505.355408:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325070208:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355418:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325069056:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355439:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325069568:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355450:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325070080:0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355490:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325068928 00000100:00100000:1.0:1788869505.355495:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325068928 00000100:00100000:1.0:1788869505.355537:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788869505.355544:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325068928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869505.355583:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325068928:12345-0@lo:400:kworker.0 Request processed in 39us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.355613:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788869505.355650:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325068928:0@lo:400:kworker.0 00000100:00100000:3.0:1788869505.357284:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325069184 00000100:00100000:3.0:1788869505.357302:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325069184 00000100:00100000:3.0:1788869505.357378:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869505.357390:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325069184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869505.357522:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325069184:12345-0@lo:400:kworker.0 Request processed in 129us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869505.357545:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869505.357637:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325069184:0@lo:400:kworker.0 00000100:00100000:0.0:1788869505.863969:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869505.863998:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325070592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869505.864101:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869505.865533:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325070592 00000100:00100000:1.0:1788869505.865548:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325070592 00000100:00100000:1.0:1788869505.865666:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788869505.865678:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325070592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869505.865720:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869505.865803:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325070592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.865811:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788869505.866140:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869505.866161:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325070720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869505.866214:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788869505.866359:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703bab100 x1875765325070592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869505.866382:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325070592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869505.866513:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325070720 00000100:00100000:1.0:1788869505.866536:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325070720 00000100:00100000:1.0:1788869505.866578:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788869505.866610:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325070720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869505.866626:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869505.866761:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325070720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 175us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869505.866768:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:3.0:1788869505.867174:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0bf100 x1875765325070720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869505.867192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325070720:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788869506.245853:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869507.272926:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869507.398683:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325070848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869507.398780:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869507.400111:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325070848 00000100:00100000:2.0:1788869507.400124:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325070848 00000100:00100000:2.0:1788869507.400186:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788869507.400195:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325070848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869507.400229:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869507.400304:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325070848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869507.400311:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788869507.400409:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325070848:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788869508.294811:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869508.422042:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869508.422070:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325070976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869508.422155:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869508.422809:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869508.422821:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325071104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869508.422856:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869508.422930:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325070976 00000100:00100000:2.0:1788869508.422939:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325070976 00000100:00100000:2.0:1788869508.423010:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325071104 00000100:00100000:2.0:1788869508.423014:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325071104 00000100:00100000:2.0:1788869508.423049:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788869508.423062:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325070976:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869508.423067:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788869508.423078:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325071104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869508.423123:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788869508.423123:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869508.423181:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325071104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869508.423181:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325070976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869508.423189:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788869508.423257:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325070976:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788869508.423902:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869508.423941:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325071104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869508.424025:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00010000:0.0:1788869509.317908:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869509.446023:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869509.446054:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325071232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869509.446159:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869509.446514:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325071232 00000100:00100000:1.0:1788869509.446524:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325071232 00000100:00100000:1.0:1788869509.446604:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788869509.446614:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325071232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869509.446657:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869509.446722:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325071232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.446730:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788869509.446957:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325071232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869509.573326:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869509.573484:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869509.573527:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869509.573558:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869509.573625:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869509.573674:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869509.573714:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305047936 00000100:00100000:1.0:1788869509.573741:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305047936 00000100:00100000:1.0:1788869509.573809:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305048064 00000100:00100000:1.0:1788869509.573813:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305048064 00000100:00100000:1.0:1788869509.573825:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305048320 00000100:00100000:1.0:1788869509.573827:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305048320 00000100:00100000:1.0:1788869509.573840:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305048448 00000100:00100000:1.0:1788869509.573842:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305048448 00000100:00100000:1.0:1788869509.573858:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 274 00000100:00100000:1.0:1788869509.573869:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305047936:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869509.573963:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305047936:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 96us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.573971:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 274 00000100:00100000:1.0:1788869509.574008:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 275 00000100:00100000:1.0:1788869509.574015:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305048064:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869509.574041:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305048064:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.574047:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 275 00000100:00100000:1.0:1788869509.574060:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 276 00000100:00100000:1.0:1788869509.574066:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305048320:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869509.574086:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305048320:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 20us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.574091:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 276 00000100:00100000:1.0:1788869509.574101:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:1.0:1788869509.574107:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305048448:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869509.574135:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305048448:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.574141:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:1.0:1788869509.574164:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305048192 00000100:00100000:1.0:1788869509.574167:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305048192 00000100:00100000:1.0:1788869509.574195:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:1.0:1788869509.574202:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305048192:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869509.574245:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305048192:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 43us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.574252:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00080000:1.0:1788869509.574277:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869509.574282:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869509.574284:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869509.576213:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305047808 00000100:00100000:0.0:1788869509.576230:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305047808 00000100:00100000:0.0:1788869509.576301:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 380 00000100:00100000:0.0:1788869509.576310:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305047808:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869509.576456:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305047808:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 147us (3140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869509.576473:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 380 00010000:00010000:0.0:1788869510.342606:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869510.470274:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325071744:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470471:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325072256:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470502:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470528:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325072768:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470573:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470628:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788869510.470635:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325071616:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470661:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470679:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325072128:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470698:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325072640:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470724:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470751:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325071360:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470779:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470798:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325071872:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470819:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470833:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325072384:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470853:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470869:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325072896:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470900:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470918:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788869510.470923:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325071488:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470945:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.470978:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325072000:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.470999:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.471009:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325072512:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471030:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869510.471054:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325071744 00000100:00100000:2.0:1788869510.471064:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325071744 00000100:00100000:2.0:1788869510.471104:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325072128 00000100:00100000:2.0:1788869510.471107:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325072128 00000100:00100000:2.0:1788869510.471132:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325072640 00000100:00100000:2.0:1788869510.471135:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325072640 00000100:00100000:2.0:1788869510.471148:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325071488 00000100:00100000:2.0:1788869510.471150:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325071488 00000100:00100000:2.0:1788869510.471159:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325072000 00000100:00100000:2.0:1788869510.471161:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325072000 00000100:00100000:2.0:1788869510.471171:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325072512 00000100:00100000:2.0:1788869510.471173:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325072512 00000100:00100000:2.0:1788869510.471187:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788869510.471195:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325071744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471250:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325071744:12345-0@lo:400:kworker.0 Request processed in 55us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869510.471257:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788869510.471275:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788869510.471281:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325072128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471306:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325072128:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869510.471319:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788869510.471343:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788869510.471349:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325072640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471377:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325072640:12345-0@lo:400:kworker.0 Request processed in 29us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869510.471382:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788869510.471393:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788869510.471398:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325071488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471428:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325071488:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869510.471433:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788869510.471445:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788869510.471451:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325072000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471492:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325072000:12345-0@lo:400:kworker.0 Request processed in 42us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869510.471498:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788869510.471510:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788869510.471516:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325072512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471540:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325072512:12345-0@lo:400:kworker.0 Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869510.471545:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00010000:00080000:2.0:1788869510.471579:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270402dc00 x1875765325072128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869510.471621:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325072128:0@lo:400:kworker.0 00010000:00080000:2.0:1788869510.471642:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270402ea00 x1875765325072640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869510.471650:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325072640:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471661:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325071744:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471692:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325071488:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471701:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325072000:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.471708:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325072512:0@lo:400:kworker.0 00000100:00100000:1.0:1788869510.472554:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325072256 00000100:00100000:1.0:1788869510.472565:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325072256 00000100:00100000:1.0:1788869510.472644:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325072768 00000100:00100000:1.0:1788869510.472648:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325072768 00000100:00100000:1.0:1788869510.472662:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325072384 00000100:00100000:1.0:1788869510.472665:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325072384 00000100:00100000:1.0:1788869510.472678:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325072896 00000100:00100000:1.0:1788869510.472681:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325072896 00000100:00100000:1.0:1788869510.472697:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788869510.472706:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325072256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869510.472780:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325072256:12345-0@lo:400:kworker.0 Request processed in 75us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869510.472787:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788869510.472817:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788869510.472823:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325072768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869510.472861:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325072768:12345-0@lo:400:kworker.0 Request processed in 38us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869510.472866:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788869510.472879:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788869510.472884:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325072384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869510.473050:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788869510.473061:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325072896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869510.473178:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325071616 00000100:00100000:3.0:1788869510.473184:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325071616 00000100:00100000:3.0:1788869510.473218:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325071872 00000100:00100000:3.0:1788869510.473221:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325071872 00000100:00100000:3.0:1788869510.473235:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788869510.473242:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325071616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869510.473285:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325071616:12345-0@lo:400:kworker.0 Request processed in 44us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869510.473290:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788869510.473302:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869510.473309:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325071872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869510.473375:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325072384:12345-0@lo:400:kworker.0 Request processed in 490us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869510.473393:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788869510.473433:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325071360 00000100:00100000:1.0:1788869510.473436:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325071360 00000100:00100000:1.0:1788869510.473474:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788869510.473480:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325071360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.476069:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325071616:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.476108:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325072256:0@lo:400:kworker.0 00010000:00080000:2.0:1788869510.476126:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270402ca80 x1875765325072768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869510.476138:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325072768:0@lo:400:kworker.0 00000100:00080000:2.0:1788869510.476405:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869510.476412:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869510.476425:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869510.476428:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869510.481448:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325072896:12345-0@lo:400:kworker.0 Request processed in 8374us (10531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869510.482079:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788869510.482485:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325071872:12345-0@lo:400:kworker.0 Request processed in 9173us (11661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869510.482521:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788869510.485858:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325071360:12345-0@lo:400:kworker.0 Request processed in 12359us (15060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869510.485877:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788869510.486301:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325071360:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.486322:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325071872:0@lo:400:kworker.0 00000100:00100000:2.0:1788869510.486871:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325072384:0@lo:400:kworker.0 00010000:00080000:2.0:1788869510.486894:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270402fb80 x1875765325072896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869510.487195:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325072896:0@lo:400:kworker.0 00000100:00100000:0.0:1788869510.985734:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325073024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869510.985852:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869510.985941:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325073024 00000100:00100000:0.0:1788869510.985952:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325073024 00000100:00100000:0.0:1788869510.986010:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788869510.986021:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325073024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869510.986064:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869510.986116:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325073024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869510.986124:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1788869510.986173:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703ba8a80 x1875765325073024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869510.986196:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325073024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869510.987155:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869510.987172:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325073152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869510.987221:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869510.987265:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325073152 00000100:00100000:3.0:1788869510.987272:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325073152 00000100:00100000:3.0:1788869510.987339:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788869510.987349:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325073152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869510.987363:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869510.987399:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325073152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869510.987405:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1788869510.987437:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0d5880 x1875765325073152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869510.987452:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325073152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788869511.366895:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869512.390360:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869512.392137:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788869512.394354:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788869512.518401:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f09c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325073280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869512.518513:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869512.519036:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325073280 00000100:00100000:1.0:1788869512.519052:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325073280 00000100:00100000:1.0:1788869512.519129:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788869512.519152:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325073280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869512.519214:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869512.535187:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325073280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 16033us (16659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869512.535204:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869512.552584:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f09c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325073280:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788869513.414093:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869513.545239:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325073408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869513.545342:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869513.545635:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325073408 00000100:00100000:1.0:1788869513.545645:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325073408 00000100:00100000:1.0:1788869513.545736:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788869513.545747:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325073408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869513.545782:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869513.545829:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325073408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869513.545836:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788869513.545912:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869513.545988:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325073408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869513.548442:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869513.548467:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f09d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325073536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869513.548541:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869513.548753:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325073536 00000100:00100000:1.0:1788869513.548761:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325073536 00000100:00100000:1.0:1788869513.548832:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788869513.548841:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325073536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869513.548863:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869513.548918:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325073536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869513.548925:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1788869513.548999:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869513.549211:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f09d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325073536:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788869514.437791:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869514.567327:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325073664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869514.567499:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869514.568426:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325073664 00000100:00100000:0.0:1788869514.568436:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325073664 00000100:00100000:0.0:1788869514.568496:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788869514.568505:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325073664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869514.568551:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869514.568652:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325073664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.568660:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788869514.569084:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325073664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869514.685210:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869514.685276:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869514.685317:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869514.685419:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305048832 00000100:00100000:3.0:1788869514.685429:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305048832 00000100:00100000:3.0:1788869514.685489:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305048704 00000100:00100000:3.0:1788869514.685507:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305048704 00000100:00100000:3.0:1788869514.685530:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 284 00000100:00100000:3.0:1788869514.685540:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305048832:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869514.685664:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305048832:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 125us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.685672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 284 00000100:00100000:3.0:1788869514.685689:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00100000:3.0:1788869514.685695:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305048704:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869514.685717:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305048704:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.685723:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00080000:1.0:1788869514.685819:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869514.685823:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869514.686405:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305048576 00000100:00100000:2.0:1788869514.686413:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305048576 00000100:00100000:2.0:1788869514.686458:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 382 00000100:00100000:2.0:1788869514.686465:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305048576:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869514.686513:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305048576:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 49us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.686520:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 382 00000100:00100000:1.0:1788869514.700673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869514.700795:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305048960 00000100:00100000:2.0:1788869514.700806:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305048960 00000100:00100000:2.0:1788869514.700898:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788869514.700911:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2406:x1875765305048960:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:2.0:1788869514.700951:0:8443:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ceaaa 00000100:00080000:2.0:1788869514.700963:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8e27036c5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869514.701023:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:0.0:1788869514.701154:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869514.701445:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+2:2406:x1875765305048960:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 537us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.701454:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1788869514.701707:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869514.701835:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869514.701860:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305049088 00000100:00100000:0.0:1788869514.701866:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305049088 00000100:00100000:0.0:1788869514.701904:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305049216 00000100:00100000:0.0:1788869514.701912:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305049216 00000100:00100000:0.0:1788869514.701935:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 286 00000100:00100000:0.0:1788869514.701943:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305049088:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:1.0:1788869514.701951:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869514.701955:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869514.701957:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869514.701990:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305049088:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 49us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.701996:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 286 00000100:00100000:0.0:1788869514.702025:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 287 00000100:00100000:0.0:1788869514.702032:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305049216:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869514.702056:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305049216:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.702062:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 287 00010000:00010000:0.0:1788869515.461937:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869515.591181:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325074048:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.591187:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325073920:0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.591270:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325073792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869515.591329:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325074176:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.598305:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869515.598479:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325074432:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.598543:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869515.598617:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325073920 00000100:00100000:2.0:1788869515.598628:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325073920 00000100:00100000:2.0:1788869515.598686:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325074432 00000100:00100000:2.0:1788869515.598690:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325074432 00000100:00100000:2.0:1788869515.598720:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788869515.598729:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325073920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.598790:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325073920:12345-0@lo:400:kworker.0 Request processed in 62us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869515.598798:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788869515.598831:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788869515.598839:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325074432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.598871:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325074432:12345-0@lo:400:kworker.0 Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869515.598877:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788869515.598925:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325074432:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.598934:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325074944:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.598958:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869515.598978:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325074944 00000100:00100000:2.0:1788869515.598982:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325074944 00000100:00100000:2.0:1788869515.599006:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788869515.599012:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325074944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.599040:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325074944:12345-0@lo:400:kworker.0 Request processed in 29us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869515.599047:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788869515.599074:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325074944:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.599383:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325073920:0@lo:400:kworker.0 00000100:00100000:1.0:1788869515.599608:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869515.599643:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325074688:0@lo:400:kworker.0 00000100:00100000:1.0:1788869515.599687:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869515.599711:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325075200:0@lo:400:kworker.0 00000100:00100000:1.0:1788869515.599731:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788869515.599760:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869515.599771:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325074176 00000100:00100000:1.0:1788869515.599776:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325074176 00000100:00100000:1.0:1788869515.599800:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788869515.599807:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325074176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869515.599858:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325074176:12345-0@lo:400:kworker.0 Request processed in 52us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869515.599864:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788869515.599910:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325074176:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.600443:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325074688 00000100:00100000:2.0:1788869515.600450:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325074688 00000100:00100000:3.0:1788869515.600463:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869515.600485:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325075200 00000100:00100000:2.0:1788869515.600488:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325075200 00000100:00100000:3.0:1788869515.600493:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325074560:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.600509:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788869515.600515:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325074688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869515.600520:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869515.600536:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325075072:0@lo:400:kworker.0 00000100:00100000:3.0:1788869515.600555:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869515.600556:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325074688:12345-0@lo:400:kworker.0 Request processed in 42us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869515.600563:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788869515.600575:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1788869515.600661:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869515.600665:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869515.600688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325074688:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.600696:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325075200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869515.600704:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325074560 00000100:00100000:1.0:1788869515.600708:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325074560 00000100:00100000:2.0:1788869515.600731:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325075200:12345-0@lo:400:kworker.0 Request processed in 37us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869515.600732:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325075072 00000100:00100000:1.0:1788869515.600734:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325075072 00000100:00100000:1.0:1788869515.600751:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788869515.600803:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869515.600855:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325074304:0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.600880:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869515.600903:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325074048 00000100:00100000:0.0:1788869515.600907:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325074048 00000100:00100000:0.0:1788869515.600933:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325074304 00000100:00100000:0.0:1788869515.600935:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325074304 00000100:00100000:0.0:1788869515.600946:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788869515.600952:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325074048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.600989:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325074048:12345-0@lo:400:kworker.0 Request processed in 36us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869515.600995:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788869515.601007:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788869515.601012:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325074304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.601043:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325074304:12345-0@lo:400:kworker.0 Request processed in 31us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869515.601048:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788869515.601075:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325074304:0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.601081:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325074816:0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.601441:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869515.601470:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325074816 00000100:00100000:0.0:1788869515.601474:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325074816 00000100:00100000:1.0:1788869515.601737:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325074560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869515.601813:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325074560:12345-0@lo:400:kworker.0 Request processed in 80us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869515.602316:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788869515.602387:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788869515.602416:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788869515.602426:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325075072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869515.602428:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325074048:0@lo:400:kworker.0 00010000:00080000:3.0:1788869515.602445:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703956d80 x1875765325074560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869515.602456:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325074560:0@lo:400:kworker.0 00000100:00100000:2.0:1788869515.602470:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325075072:12345-0@lo:400:kworker.0 Request processed in 48us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869515.602475:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00080000:3.0:1788869515.602477:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8c000 x1875765325075072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869515.602517:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788869515.602526:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325074816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869515.602531:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325073792 00000100:00100000:1.0:1788869515.602536:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325073792 00000100:00100000:0.0:1788869515.602563:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325074816:12345-0@lo:400:kworker.0 Request processed in 39us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869515.602565:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788869515.602583:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325073792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869515.602636:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325073792:12345-0@lo:400:kworker.0 Request processed in 55us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869515.602642:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788869515.602684:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788869515.602715:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325074816:0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.602726:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325075328:0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.602754:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869515.602776:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325075328 00000100:00100000:0.0:1788869515.602779:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325075328 00000100:00100000:0.0:1788869515.602805:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788869515.603661:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325075072:0@lo:400:kworker.0 00000100:00080000:3.0:1788869515.603730:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869515.603736:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869515.603739:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788869515.603769:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8dc00 x1875765325075200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869515.603778:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325075200:0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.608819:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325075328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.608953:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325075328:12345-0@lo:400:kworker.0 Request processed in 6140us (6196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869515.608964:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00080000:0.0:1788869515.609046:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f8e300 x1875765325075328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869515.609062:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325075328:0@lo:400:kworker.0 00000100:00100000:0.0:1788869515.609221:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325073792:0@lo:400:kworker.0 00000100:00100000:3.0:1788869516.102300:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869516.102327:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325075456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869516.102407:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869516.102447:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325075456 00000100:00100000:3.0:1788869516.102455:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325075456 00000100:00100000:3.0:1788869516.102500:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788869516.102508:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325075456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869516.102539:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869516.102575:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325075456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869516.102581:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:3.0:1788869516.102657:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283f47ad80 x1875765325075456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869516.102675:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325075456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869516.103615:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325075584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869516.103667:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869516.103780:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325075584 00000100:00100000:0.0:1788869516.103789:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325075584 00000100:00100000:0.0:1788869516.103849:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788869516.103857:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325075584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869516.103878:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869516.103920:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325075584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869516.103926:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:3.0:1788869516.104777:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283f47a300 x1875765325075584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869516.104895:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325075584:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788869516.486008:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869517.509845:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869517.640931:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f09fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325075712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869517.641016:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869517.641287:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325075712 00000100:00100000:0.0:1788869517.641298:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325075712 00000100:00100000:0.0:1788869517.641352:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788869517.641362:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325075712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869517.641403:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869517.645521:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325075712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4148us (4493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869517.645539:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788869517.648565:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f09fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325075712:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788869518.533760:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869518.661937:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f09d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325075840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869518.662035:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869518.662733:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325075840 00000100:00100000:2.0:1788869518.662747:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325075840 00000100:00100000:2.0:1788869518.662825:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788869518.662837:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325075840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869518.662872:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869518.662948:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325075840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869518.662972:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788869518.663011:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f09d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325075840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869518.663354:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869518.670880:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869518.670906:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325075968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869518.670984:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869518.671256:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325075968 00000100:00100000:0.0:1788869518.671267:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325075968 00000100:00100000:0.0:1788869518.671339:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788869518.671349:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325075968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869518.671377:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869518.671433:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325075968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869518.671442:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788869518.671497:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325075968:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788869518.671568:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788869519.558438:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869519.686292:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869519.686316:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325076096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869519.686386:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869519.688304:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325076096 00000100:00100000:3.0:1788869519.688322:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325076096 00000100:00100000:3.0:1788869519.688402:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788869519.688412:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325076096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869519.688457:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869519.688562:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325076096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (2174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869519.688569:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788869519.688838:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325076096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869519.803351:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869519.803405:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869519.803496:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305049344 00000100:00100000:2.0:1788869519.803507:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305049344 00000100:00100000:2.0:1788869519.803565:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 384 00000100:00100000:2.0:1788869519.803576:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2409:x1875765305049344:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869519.803698:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2409:x1875765305049344:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 124us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869519.803706:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 384 00000100:00100000:1.0:1788869519.803854:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305049472 00000100:00100000:1.0:1788869519.803860:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305049472 00000100:00100000:1.0:1788869519.804037:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 294 00000100:00100000:1.0:1788869519.804046:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305049472:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869519.804098:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305049472:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 54us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.804114:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 294 00000100:00080000:3.0:1788869519.809071:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869519.809626:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869519.811619:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305049728 00000100:00100000:3.0:1788869519.811634:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305049728 00000100:00100000:3.0:1788869519.811733:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 295 00000100:00100000:3.0:1788869519.811744:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305049728:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869519.811829:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305049728:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 88us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869519.811836:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 295 00000100:00080000:1.0:1788869519.812491:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869519.818892:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869519.819476:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869519.834941:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305049856 00000100:00100000:1.0:1788869519.834966:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305049856 00000100:00100000:1.0:1788869519.835087:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305049600 00000100:00100000:1.0:1788869519.835091:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305049600 00000100:00080000:3.0:1788869519.835218:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869519.835296:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 296 00000100:00100000:1.0:1788869519.835321:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305049856:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869519.835437:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305049856:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 121us (16557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869519.843933:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 297 00000100:00100000:0.0:1788869519.843963:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305049600:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869519.844059:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305049600:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 112us (24585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869519.844067:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 297 00000100:00100000:1.0:1788869519.846959:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 296 00000001:00100000:2.0:1788869520.200361:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:2.0:1788869520.200373:0:8435:0:(genops.c:885:class_export_put()) final put ffff8e27036c0000/91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:3.0:1788869520.200486:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27036c0000/91cba2f3-33fb-476e-a4a1-b4fbee1b176d for lustre-OST0000 00000020:00000080:3.0:1788869520.200557:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e27036c5800 for lustre-OST0000 00010000:00010000:0.0:1788869520.581845:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869520.709947:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325076224:0@lo:400:kworker.0 00000100:00100000:1.0:1788869520.710056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869520.710212:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325076224 00000100:00100000:2.0:1788869520.710236:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325076224 00000100:00100000:2.0:1788869520.710303:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788869520.710313:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325076224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.710449:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325076352:0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.710491:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869520.710532:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325076352 00000100:00100000:0.0:1788869520.710536:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325076352 00000100:00100000:0.0:1788869520.710568:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788869520.710575:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325076352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.710639:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325076352:12345-0@lo:400:kworker.0 Request processed in 64us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869520.710646:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788869520.710692:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325076352:0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.713864:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325076224:12345-0@lo:400:kworker.0 Request processed in 3543us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869520.713880:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788869520.714341:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325076224:0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.716409:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325076480:0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.716489:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869520.716540:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325076992:0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.716614:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869520.716641:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788869520.716648:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325076608:0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.716670:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869520.716691:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325077120:0@lo:400:kworker.0 00000100:00100000:1.0:1788869520.716820:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325076480 00000100:00100000:1.0:1788869520.716829:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325076480 00000100:00100000:1.0:1788869520.716883:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788869520.716893:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325076480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869520.716946:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325076480:12345-0@lo:400:kworker.0 Request processed in 55us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869520.716953:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788869520.717018:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325076992 00000100:00100000:3.0:1788869520.717024:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325076992 00000100:00100000:3.0:1788869520.717061:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325076608 00000100:00100000:3.0:1788869520.717065:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325076608 00000100:00100000:3.0:1788869520.717078:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788869520.717086:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325076992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869520.717124:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325076992:12345-0@lo:400:kworker.0 Request processed in 39us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869520.717230:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788869520.717303:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788869520.717311:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325076608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869520.717339:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325076608:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869520.717344:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:3.0:1788869520.717368:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869520.717381:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325076864:0@lo:400:kworker.0 00000100:00100000:3.0:1788869520.717403:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869520.718350:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869520.718421:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325076480:0@lo:400:kworker.0 00010000:00080000:2.0:1788869520.718437:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283f47e300 x1875765325076992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869520.718449:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325076992:0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.718473:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325076608:0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.718498:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325076864 00000100:00100000:2.0:1788869520.718503:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325076864 00000100:00100000:2.0:1788869520.718546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788869520.718554:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325076864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.718618:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325076864:12345-0@lo:400:kworker.0 Request processed in 65us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869520.718625:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:2.0:1788869520.718642:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869520.718868:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325077120 00000100:00100000:1.0:1788869520.718872:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325077120 00000100:00100000:1.0:1788869520.718906:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788869520.718914:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325077120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869520.718956:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325077120:12345-0@lo:400:kworker.0 Request processed in 44us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869520.718962:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788869520.719830:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869520.719878:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325077120:0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.723668:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325076736:0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.723755:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869520.723845:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325077248:0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.723871:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869520.723920:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325077248 00000100:00100000:0.0:1788869520.723928:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325077248 00000100:00100000:0.0:1788869520.723992:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788869520.724002:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325077248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.724058:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325077248:12345-0@lo:400:kworker.0 Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869520.724080:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1788869520.724103:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869520.724153:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325077248:0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.726425:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325077504:0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.726505:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869520.726564:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325077504 00000100:00100000:2.0:1788869520.726610:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325077504 00000100:00100000:2.0:1788869520.726693:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788869520.726702:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325077504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.726767:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325077504:12345-0@lo:400:kworker.0 Request processed in 66us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869520.726775:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:0.0:1788869520.726782:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869520.726795:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869520.726804:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325077376:0@lo:400:kworker.0 00010000:00080000:2.0:1788869520.726814:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5d500 x1875765325077504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869520.726827:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325077504:0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.726832:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869520.726858:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869520.726860:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325077376 00000100:00100000:2.0:1788869520.726863:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325077632:0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.726863:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325077376 00000100:00100000:2.0:1788869520.726890:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869520.726895:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788869520.726901:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325077376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.726930:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325077376:12345-0@lo:400:kworker.0 Request processed in 30us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869520.726936:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788869520.726953:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325077632 00000100:00100000:0.0:1788869520.726956:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325077632 00000100:00100000:0.0:1788869520.726989:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788869520.726996:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325077632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.727032:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325077632:12345-0@lo:400:kworker.0 Request processed in 37us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869520.727038:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1788869520.727053:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869520.727056:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788869520.727073:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2840f14380 x1875765325077632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869520.727083:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325077632:0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.727110:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325077760:0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.727663:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869520.727708:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325077376:0@lo:400:kworker.0 00000100:00100000:3.0:1788869520.728642:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325076864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869520.729056:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325076736 00000100:00100000:1.0:1788869520.729064:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325076736 00000100:00100000:2.0:1788869520.729226:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325077760 00000100:00100000:2.0:1788869520.729231:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325077760 00000100:00100000:2.0:1788869520.729283:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869520.729292:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325077760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869520.729371:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325077760:12345-0@lo:400:kworker.0 Request processed in 80us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869520.729379:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788869520.729430:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788869520.729438:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325076736:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788869520.729459:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869520.729480:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325076736:12345-0@lo:400:kworker.0 Request processed in 44us (5726us total) trans 0 rc 0/0 00010000:00080000:0.0:1788869520.729484:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5d500 x1875765325077760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869520.729486:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788869520.729496:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325077760:0@lo:400:kworker.0 00000100:00100000:0.0:1788869520.729506:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325076736:0@lo:400:kworker.0 00000100:00100000:1.0:1788869521.228480:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325077888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869521.228556:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869521.228652:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325077888 00000100:00100000:1.0:1788869521.228662:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325077888 00000100:00100000:1.0:1788869521.228789:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788869521.228816:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325077888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869521.228854:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869521.228906:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325077888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869521.228913:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:1.0:1788869521.228979:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270402e300 x1875765325077888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869521.229000:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325077888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869521.230387:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325078016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869521.230451:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869521.230747:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325078016 00000100:00100000:0.0:1788869521.230755:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325078016 00000100:00100000:0.0:1788869521.230797:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788869521.230804:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325078016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869521.230823:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869521.230863:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325078016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869521.230870:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:0.0:1788869521.230907:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283f47ad80 x1875765325078016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869521.230925:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325078016:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788869521.607127:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869522.630406:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788869522.631650:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788869522.632111:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869522.760639:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869522.760665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325078144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869522.760744:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869522.761293:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325078144 00000100:00100000:1.0:1788869522.761306:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325078144 00000100:00100000:1.0:1788869522.761375:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788869522.761388:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325078144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869522.761439:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869522.761515:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325078144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869522.761522:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788869522.761714:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325078144:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788869523.654282:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869523.781801:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325078272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869523.781892:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869523.782168:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325078272 00000100:00100000:0.0:1788869523.782178:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325078272 00000100:00100000:0.0:1788869523.782241:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788869523.782251:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325078272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869523.782284:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869523.782334:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325078272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869523.782341:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1788869523.782367:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869523.782634:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325078272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869523.783034:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869523.783047:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325078400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869523.783098:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869523.783228:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325078400 00000100:00100000:1.0:1788869523.783234:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325078400 00000100:00100000:1.0:1788869523.783281:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788869523.783289:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325078400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869523.783305:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869523.783346:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325078400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869523.783354:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1788869523.783421:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869523.783447:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325078400:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788869524.693746:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869524.808901:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325078528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869524.808984:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869524.809272:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325078528 00000100:00100000:2.0:1788869524.809281:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325078528 00000100:00100000:2.0:1788869524.809340:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788869524.809352:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325078528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869524.809397:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869524.809459:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325078528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869524.809467:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788869524.809565:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325078528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869524.929925:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869524.929974:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869524.930030:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869524.930065:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869524.930100:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869524.930224:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305049984 00000100:00100000:2.0:1788869524.930236:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305049984 00000100:00100000:2.0:1788869524.930292:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 386 00000100:00100000:2.0:1788869524.930303:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305049984:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869524.930381:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305049984:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 80us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869524.930388:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 386 00000100:00100000:0.0:1788869524.930475:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305050240 00000100:00100000:0.0:1788869524.930480:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305050240 00000100:00100000:0.0:1788869524.930525:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305050496 00000100:00100000:0.0:1788869524.930536:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305050496 00000100:00100000:0.0:1788869524.930555:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305050112 00000100:00100000:0.0:1788869524.930558:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305050112 00000100:00100000:0.0:1788869524.930569:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305050368 00000100:00100000:0.0:1788869524.930571:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305050368 00000100:00100000:0.0:1788869524.930641:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 304 00000100:00100000:0.0:1788869524.930651:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305050240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869524.930687:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305050240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 39us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.930694:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 304 00000100:00100000:0.0:1788869524.930710:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:0.0:1788869524.930716:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305050496:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869524.930739:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305050496:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.930745:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:0.0:1788869524.930757:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 306 00000100:00100000:0.0:1788869524.930763:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305050112:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869524.930788:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305050112:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.930794:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 306 00000100:00100000:0.0:1788869524.930807:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 307 00000100:00100000:0.0:1788869524.930813:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305050368:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869524.930835:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305050368:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.930841:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 307 00000100:00080000:2.0:1788869524.931102:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869524.931107:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788869525.702212:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869525.840988:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325078656:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.841104:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869525.843092:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325078784:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.843174:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869525.843503:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325078912:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.843539:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869525.843844:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325078784 00000100:00100000:2.0:1788869525.843854:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325078784 00000100:00100000:2.0:1788869525.844080:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788869525.844091:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325078784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.844175:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325078784:12345-0@lo:400:kworker.0 Request processed in 86us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869525.844183:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788869525.844209:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325078912 00000100:00100000:2.0:1788869525.844213:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325078912 00000100:00100000:2.0:1788869525.844349:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788869525.844357:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325078912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.844402:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325078912:12345-0@lo:400:kworker.0 Request processed in 46us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869525.844422:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788869525.844473:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325078784:0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.844506:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325078912:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.845205:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325079040:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.845259:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869525.845350:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325079168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.845377:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869525.845412:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325079168 00000100:00100000:3.0:1788869525.845418:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325079168 00000100:00100000:3.0:1788869525.845447:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788869525.845454:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325079168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.845499:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325079168:12345-0@lo:400:kworker.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869525.845506:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788869525.845538:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325079168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.845607:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325079552:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.847358:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869525.847434:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325079552 00000100:00100000:3.0:1788869525.847444:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325079552 00000100:00100000:3.0:1788869525.847496:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788869525.847506:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325079552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.848539:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325079552:12345-0@lo:400:kworker.0 Request processed in 104us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869525.848557:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788869525.848689:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325079552:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.848762:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325079680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.848811:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869525.848884:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325080064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.848907:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869525.848954:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325080192:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.849001:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869525.849052:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325079680 00000100:00100000:3.0:1788869525.849057:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325079680 00000100:00100000:3.0:1788869525.849090:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325080064 00000100:00100000:3.0:1788869525.849093:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325080064 00000100:00100000:3.0:1788869525.849122:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325080192 00000100:00100000:3.0:1788869525.849125:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325080192 00000100:00100000:3.0:1788869525.849143:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788869525.849151:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325079680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.849200:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325079680:12345-0@lo:400:kworker.0 Request processed in 49us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869525.849207:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788869525.849221:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788869525.849226:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325080064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.849258:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325080064:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869525.849264:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788869525.849282:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788869525.849288:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325080192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.849315:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325080192:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869525.849321:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00080000:3.0:1788869525.849355:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283f47e300 x1875765325080192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869525.849366:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325080192:0@lo:400:kworker.0 00000100:00100000:3.0:1788869525.849376:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325079680:0@lo:400:kworker.0 00010000:00080000:3.0:1788869525.849396:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283f47c380 x1875765325080064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869525.849404:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325080064:0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.851384:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325079040 00000100:00100000:2.0:1788869525.851400:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325079040 00000100:00100000:2.0:1788869525.851459:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788869525.851469:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325079040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.851583:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325079040:12345-0@lo:400:kworker.0 Request processed in 115us (6323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869525.851607:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788869525.851663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325079296:0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.851710:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869525.851737:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325079808:0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.851759:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869525.851781:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788869525.851788:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325079424:0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.851808:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869525.851824:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325079936:0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.851849:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788869525.851875:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869525.851881:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869525.851900:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325079296 00000100:00100000:2.0:1788869525.851904:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325079296 00000100:00100000:2.0:1788869525.851927:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325079808 00000100:00100000:2.0:1788869525.851930:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325079808 00000100:00100000:2.0:1788869525.851961:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325079424 00000100:00100000:2.0:1788869525.851964:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325079424 00000100:00100000:2.0:1788869525.851977:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325079936 00000100:00100000:2.0:1788869525.851979:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325079936 00000100:00100000:2.0:1788869525.851995:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788869525.852000:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325079296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.852049:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325079296:12345-0@lo:400:kworker.0 Request processed in 48us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869525.852056:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788869525.852068:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788869525.852073:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325079808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.852101:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325079808:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869525.852107:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788869525.852132:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788869525.852137:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325079424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.852161:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325079424:12345-0@lo:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869525.852167:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788869525.852176:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788869525.852181:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325079936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.852201:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325079936:12345-0@lo:400:kworker.0 Request processed in 21us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869525.852207:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788869525.852246:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325079040:0@lo:400:kworker.0 00000100:00080000:2.0:1788869525.852273:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869525.852282:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788869525.852301:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283f47f800 x1875765325079424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869525.852312:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325079424:0@lo:400:kworker.0 00010000:00080000:2.0:1788869525.852321:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283f47fb80 x1875765325079936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869525.852329:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325079936:0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.852337:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325079296:0@lo:400:kworker.0 00000100:00100000:2.0:1788869525.852344:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325079808:0@lo:400:kworker.0 00000100:00100000:1.0:1788869525.856375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325078656 00000100:00100000:1.0:1788869525.856425:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325078656 00000100:00100000:1.0:1788869525.856522:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788869525.856538:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325078656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869525.856743:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325078656:12345-0@lo:400:kworker.0 Request processed in 208us (15638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869525.856751:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788869525.859867:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325078656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869526.341972:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325080320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869526.342076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869526.342219:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325080320 00000100:00100000:0.0:1788869526.342229:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325080320 00000100:00100000:0.0:1788869526.342289:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788869526.342300:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325080320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869526.342339:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869526.342402:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325080320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869526.342410:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:2.0:1788869526.342786:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040fce00 x1875765325080320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869526.342809:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325080320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869526.342947:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869526.342957:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325080448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869526.342988:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869526.343131:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325080448 00000100:00100000:0.0:1788869526.343136:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325080448 00000100:00100000:0.0:1788869526.343173:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788869526.343181:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325080448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869526.343194:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869526.343235:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325080448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869526.343242:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:1.0:1788869526.343340:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040fed80 x1875765325080448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869526.343355:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325080448:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788869526.733079:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869527.573578:0:14069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:12:04 (1788869524) 00010000:00010000:0.0:1788869527.750555:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869527.878075:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325080576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869527.878176:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869527.878438:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325080576 00000100:00100000:2.0:1788869527.878449:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325080576 00000100:00100000:2.0:1788869527.878514:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788869527.878544:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325080576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869527.878623:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869527.878682:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325080576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869527.878690:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788869527.878783:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325080576:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869528.773935:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869528.901888:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869528.901914:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325080704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869528.902022:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869528.902169:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325080704 00000100:00100000:1.0:1788869528.902180:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325080704 00000100:00100000:1.0:1788869528.902257:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788869528.902270:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325080704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869528.902308:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869528.902357:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325080704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869528.902364:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788869528.902467:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869528.902562:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325080704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869528.903749:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325080832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869528.903799:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869528.903894:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325080832 00000100:00100000:2.0:1788869528.903901:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325080832 00000100:00100000:2.0:1788869528.903959:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788869528.903968:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325080832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869528.903996:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869528.904043:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325080832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869528.904049:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788869528.904169:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325080832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869528.904496:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869529.412910:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869529.412991:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305050624 00000100:00100000:2.0:1788869529.413002:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305050624 00000100:00100000:2.0:1788869529.413103:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:2.0:1788869529.413117:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:11105:x1875765305050624:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869529.413139:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869529.413165:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceb8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d80 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.413252:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.413268:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.413299:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869529.413356:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869529.413360:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869529.413403:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.413430:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceb8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d80 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.413464:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d80 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.413473:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b600) 00010000:00010000:2.0:1788869529.413476:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869529.413479:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edae00, rc 0) 00000100:00100000:2.0:1788869529.413781:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:11105:x1875765305050624:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 667us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869529.413789:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00080000:3.0:1788869529.414865:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869529.425153:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869529.429315:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305050752 00000100:00100000:2.0:1788869529.429797:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305050752 00000100:00100000:2.0:1788869529.429941:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1788869529.429953:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:11106:x1875765305050752:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869529.429983:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869529.430006:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceb98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d87 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430096:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430110:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430122:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430135:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430142:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430149:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430215:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cebad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430222:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cebad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430229:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cebad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869529.430265:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869529.430268:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869529.430286:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cebad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430307:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430314:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430331:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430337:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869529.430341:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430349:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430361:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b600) 00010000:00010000:2.0:1788869529.430364:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869529.430370:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430376:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6ceb9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430391:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430397:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430404:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430414:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869529.430417:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430424:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430432:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e2803b9bb00) 00010000:00010000:2.0:1788869529.430435:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869529.430438:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430444:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6ceba6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430478:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceb98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d87 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430490:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cebad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d87 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.430498:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2803b9b000) 00010000:00010000:2.0:1788869529.430500:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869529.430503:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb600, rc 0) 00000100:00100000:2.0:1788869529.430639:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:11106:x1875765305050752:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 635us (5578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869529.430647:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1788869529.437893:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869529.438021:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305050880 00000100:00100000:3.0:1788869529.438044:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305050880 00000100:00100000:3.0:1788869529.438109:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788869529.438120:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:11106:x1875765305050880:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788869529.438217:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:11106:x1875765305050880:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 99us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869529.438226:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788869529.445141:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869529.445282:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305051136 00000100:00100000:2.0:1788869529.445307:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305051136 00000100:00100000:2.0:1788869529.445379:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1788869529.445391:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:11106:x1875765305051136:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869529.445415:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869529.445441:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cebb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d8e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.445533:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.445548:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.445561:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.445678:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.445686:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869529.445695:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446181:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cebc9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446194:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cebc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446213:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cebc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869529.446227:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788869529.446338:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446347:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446362:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446368:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869529.446372:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446380:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446393:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2803b9b000) 00010000:00010000:1.0:1788869529.446395:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869529.446401:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446407:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cebbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446421:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446427:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446848:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446854:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869529.446857:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446864:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446873:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e2803b9bb00) 00010000:00010000:1.0:1788869529.446876:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869529.446879:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.446885:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cebc2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.447199:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cebb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d8e expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.447217:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cebc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d8e expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869529.447224:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:1.0:1788869529.447226:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869529.447229:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7fa00, rc 0) 00000100:00100000:1.0:1788869529.448919:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:11106:x1875765305051136:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3518us (3774us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788869529.448953:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788869529.465775:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869529.467842:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305051264 00000100:00100000:0.0:1788869529.467859:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305051264 00000100:00100000:0.0:1788869529.467937:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1788869529.467948:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:11106:x1875765305051264:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788869529.468080:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:11106:x1875765305051264:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 133us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869529.468089:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1788869529.480254:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869529.480542:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305051392 00000100:00100000:2.0:1788869529.480711:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305051392 00000100:00100000:2.0:1788869529.480865:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788869529.480876:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:11106:x1875765305051392:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788869529.486244:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788869529.486605:0:8260:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5684us 00000100:00100000:3.0:1788869529.518508:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:11106:x1875765305051392:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 37623us (38255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869529.518521:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00010000:00010000:2.0:1788869529.799303:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869529.800266:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788869529.801114:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869529.926888:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869529.926913:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325080960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869529.927001:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869529.927080:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325080960 00000100:00100000:2.0:1788869529.927090:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325080960 00000100:00100000:2.0:1788869529.927146:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869529.927157:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325080960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869529.927203:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869529.927262:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325080960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869529.927270:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869529.927322:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325080960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869530.044684:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869530.044782:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869530.049968:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869530.050005:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869530.050070:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305051648 00000100:00100000:0.0:1788869530.050081:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305051648 00000100:00100000:0.0:1788869530.050134:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305051904 00000100:00100000:0.0:1788869530.050138:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305051904 00000100:00100000:0.0:1788869530.050171:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 314 00000100:00100000:0.0:1788869530.050182:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2410:x1875765305051648:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869530.050255:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2410:x1875765305051648:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 75us (5580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.050262:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 314 00000100:00100000:0.0:1788869530.050283:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 315 00000100:00100000:0.0:1788869530.050290:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305051904:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869530.050316:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305051904:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (5534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.050322:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 315 00000100:00100000:3.0:1788869530.055969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869530.056010:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305051520 00000100:00100000:3.0:1788869530.056020:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305051520 00000100:00100000:3.0:1788869530.056143:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 388 00000100:00100000:3.0:1788869530.056154:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305051520:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869530.056229:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305051520:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 77us (6284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.056237:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 388 00000100:00080000:3.0:1788869530.056273:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869530.056288:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305051776 00000100:00100000:3.0:1788869530.056292:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305051776 00000100:00100000:3.0:1788869530.056318:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305052032 00000100:00100000:3.0:1788869530.056321:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305052032 00000100:00100000:0.0:1788869530.056442:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 316 00000100:00100000:0.0:1788869530.056551:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305051776:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869530.060077:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305051776:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 3612us (10056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.060092:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 316 00000100:00100000:3.0:1788869530.071090:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 317 00000100:00100000:3.0:1788869530.071109:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305052032:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869530.071208:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305052032:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 104us (15261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.071217:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 317 00000100:00080000:3.0:1788869530.071388:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788869530.826573:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869530.949953:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325081088:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.950103:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869530.950226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325081088 00000100:00100000:2.0:1788869530.950244:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325081088 00000100:00100000:2.0:1788869530.950302:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788869530.950312:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325081088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.954336:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325081216:0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.954435:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869530.957551:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325081088:12345-0@lo:400:kworker.0 Request processed in 7229us (7437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869530.957566:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788869530.960540:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325081216 00000100:00100000:0.0:1788869530.960575:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325081216 00000100:00100000:0.0:1788869530.960670:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788869530.960682:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325081216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.960799:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325081216:12345-0@lo:400:kworker.0 Request processed in 111us (6355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.960807:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788869530.960857:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325081216:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.962514:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325081088:0@lo:400:kworker.0 00000100:00100000:2.0:1788869530.963489:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325081344:0@lo:400:kworker.0 00000100:00100000:2.0:1788869530.963571:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.963705:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325081472:0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.963734:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869530.965561:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325081344 00000100:00100000:3.0:1788869530.965578:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325081344 00000100:00100000:3.0:1788869530.965677:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788869530.965686:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325081344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.969848:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325081344:12345-0@lo:400:kworker.0 Request processed in 4153us (6266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.969864:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788869530.970093:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325081472 00000100:00100000:3.0:1788869530.970105:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325081472 00000100:00100000:3.0:1788869530.970226:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788869530.970236:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325081472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.970314:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325081472:12345-0@lo:400:kworker.0 Request processed in 80us (6578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.970321:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788869530.970403:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325081600:0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.970417:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325081984:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.970455:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.970467:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869530.970491:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325081600 00000100:00100000:3.0:1788869530.970497:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325081600 00000100:00100000:0.0:1788869530.970501:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325082496:0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.970528:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869530.970548:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788869530.970556:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325081600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.970573:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325081472:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.970621:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325081600:12345-0@lo:400:kworker.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.970623:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788869530.970634:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325081856:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.970635:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788869530.970658:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325081984 00000100:00100000:3.0:1788869530.970663:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325081984 00000100:00100000:0.0:1788869530.970667:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.970689:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325082368:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.970701:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325082496 00000100:00100000:3.0:1788869530.970705:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325082496 00000100:00100000:0.0:1788869530.970714:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869530.970733:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788869530.970743:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325081984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.970752:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325081856 00000100:00100000:0.0:1788869530.970758:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325081856 00000100:00100000:3.0:1788869530.970785:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325081984:12345-0@lo:400:kworker.0 Request processed in 44us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.970789:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325082368 00000100:00100000:3.0:1788869530.970794:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788869530.970794:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325082368 00000100:00100000:3.0:1788869530.970812:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788869530.970822:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325082496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.970828:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788869530.970839:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325081856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.970855:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325082496:12345-0@lo:400:kworker.0 Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.970861:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1788869530.970882:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869530.970889:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869530.970893:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869530.970894:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325081856:12345-0@lo:400:kworker.0 Request processed in 57us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.970903:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788869530.970911:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788869530.970931:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325081728:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.971267:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325082368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.971302:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325082368:12345-0@lo:400:kworker.0 Request processed in 384us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.971308:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00010000:00080000:3.0:1788869530.971355:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270417df80 x1875765325081856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869530.971367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325081856:0@lo:400:kworker.0 00010000:00080000:3.0:1788869530.971379:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270417ea00 x1875765325082368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869530.971387:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325082368:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.971397:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325081984:0@lo:400:kworker.0 00010000:00080000:3.0:1788869530.971407:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270417c380 x1875765325082496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869530.971414:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325082496:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.971446:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325081600:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.971453:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325082112:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.971476:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869530.971554:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325082624:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.971575:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.971686:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325082112 00000100:00100000:1.0:1788869530.971691:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325082112 00000100:00100000:1.0:1788869530.971729:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325082624 00000100:00100000:1.0:1788869530.971732:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325082624 00000100:00100000:1.0:1788869530.971751:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788869530.971757:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325082112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869530.971796:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325082112:12345-0@lo:400:kworker.0 Request processed in 40us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.971802:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788869530.971846:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788869530.971853:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325082624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869530.971880:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325082624:12345-0@lo:400:kworker.0 Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.971886:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1788869530.971905:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869530.971909:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869530.972743:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.972810:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325082240:0@lo:400:kworker.0 00000100:00100000:0.0:1788869530.972854:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.972894:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325081728 00000100:00100000:0.0:1788869530.972913:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325081728 00000100:00100000:1.0:1788869530.973133:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325082240 00000100:00100000:1.0:1788869530.973138:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325082240 00000100:00100000:1.0:1788869530.973165:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788869530.973172:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325081728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869530.973228:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325081728:12345-0@lo:400:kworker.0 Request processed in 56us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.973236:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788869530.973252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788869530.973257:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325082240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869530.973298:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325082240:12345-0@lo:400:kworker.0 Request processed in 41us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.973305:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1788869530.973331:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869530.973366:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325081728:0@lo:400:kworker.0 00000100:00100000:1.0:1788869530.973376:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325082240:0@lo:400:kworker.0 00010000:00080000:3.0:1788869530.973485:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270417d880 x1875765325082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869530.973495:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325082624:0@lo:400:kworker.0 00000100:00100000:3.0:1788869530.973518:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325082112:0@lo:400:kworker.0 00000100:00100000:2.0:1788869530.974498:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325081344:0@lo:400:kworker.0 00000100:00100000:1.0:1788869531.461938:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325082752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869531.462048:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869531.462964:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325082752 00000100:00100000:2.0:1788869531.462991:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325082752 00000100:00100000:2.0:1788869531.463058:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788869531.463069:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325082752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869531.463114:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869531.463175:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325082752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869531.463182:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:1.0:1788869531.463284:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040fe680 x1875765325082752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869531.463306:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325082752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869531.463545:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325082880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869531.463710:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869531.463869:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325082880 00000100:00100000:1.0:1788869531.463874:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325082880 00000100:00100000:1.0:1788869531.463906:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788869531.463932:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c88f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325082880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869531.463948:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869531.464860:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c88f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325082880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 942us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869531.464870:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:3.0:1788869531.465143:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040fe680 x1875765325082880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869531.465167:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325082880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869531.848829:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:0.0:1788869531.848945:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869531.849108:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305052160 00000100:00100000:3.0:1788869531.849119:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305052160 00000100:00100000:3.0:1788869531.849192:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788869531.849203:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:11148:x1875765305052160:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869531.849225:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869531.849243:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0400/0x4c16c38a9b6cebd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d95 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849312:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849327:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849337:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849352:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849358:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849365:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849408:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849430:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849437:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849443:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe0800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869531.849447:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849455:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849467:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b600) 00010000:00010000:3.0:1788869531.849470:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869531.849475:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849480:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cebde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849492:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849511:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849517:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849521:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe0000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869531.849530:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849536:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849543:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e270365c600) 00010000:00010000:3.0:1788869531.849546:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869531.849549:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849554:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cebe5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849612:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0400/0x4c16c38a9b6cebd7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d95 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849623:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b600) 00010000:00010000:3.0:1788869531.849625:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869531.849629:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0400/0x4c16c38a9b6cebd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d95 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869531.849639:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe0400, rc 0) 00000100:00100000:3.0:1788869531.849697:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:11148:x1875765305052160:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 496us (881us total) trans 0 rc 301/301 00000100:00100000:3.0:1788869531.849704:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00080000:2.0:1788869531.849869:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869531.856980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869531.857064:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305052416 00000100:00100000:0.0:1788869531.857075:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305052416 00000100:00100000:0.0:1788869531.857140:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788869531.857151:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:11148:x1875765305052416:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:0.0:1788869531.857210:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869531.857239:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceb91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d80 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857260:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2803b9b600) 00010000:00010000:0.0:1788869531.857272:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869531.857342:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857357:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857368:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857396:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857404:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857411:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857931:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857943:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857950:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869531.857966:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000daaa61ee reply state 00000000ed0f4a4e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857975:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.857981:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:0.0:1788869531.857984:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869531.857986:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788869531.857990:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788869531.857997:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.858003:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.858016:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.858021:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869531.858025:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.858033:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.858040:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28029d9e00) 00010000:00010000:0.0:1788869531.858043:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869531.858046:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.858051:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cebec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869531.858065:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000daaa61ee reply state 00000000ed0f4a4e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.858072:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869531.858078:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e28029d9b00) 00010000:00010000:0.0:1788869531.858080:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869531.858082:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788869531.858182:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:11148:x1875765305052416:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 1032us (1212us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788869531.858190:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1788869532.005357:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869532.005549:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305052544 00000100:00100000:1.0:1788869532.005562:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305052544 00000100:00100000:1.0:1788869532.005665:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1788869532.005676:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:11156:x1875765305052544:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:1.0:1788869532.005706:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869532.005751:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cec01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9d9c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.005834:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cec08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.005849:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cec08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.005861:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cec08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869532.005925:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869532.005929:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869532.005975:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cec08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.006125:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cec01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d9c expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.006148:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cec08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d9c expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.006208:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecd700) 00010000:00010000:1.0:1788869532.006212:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869532.006216:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e600, rc 0) 00000100:00100000:1.0:1788869532.006280:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:11156:x1875765305052544:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 606us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869532.006287:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1788869532.073072:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869532.073160:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305052672 00000100:00100000:0.0:1788869532.073171:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305052672 00000100:00100000:0.0:1788869532.073244:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1788869532.073255:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:11162:x1875765305052672:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869532.073277:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869532.073298:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cec0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9da3 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073371:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073387:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073400:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073412:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073419:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073425:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073657:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8000/0x4c16c38a9b6cec24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073666:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8000/0x4c16c38a9b6cec24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073695:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8000/0x4c16c38a9b6cec24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869532.073730:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788869532.073733:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869532.073787:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8000/0x4c16c38a9b6cec24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073800:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073807:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073814:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073822:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869532.073827:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073834:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073845:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecd700) 00010000:00010000:0.0:1788869532.073848:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869532.073854:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073859:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cec16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073882:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073888:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073894:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073905:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869532.073908:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073925:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073933:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e28029d9b00) 00010000:00010000:0.0:1788869532.073935:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869532.073938:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073943:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cec1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073967:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cec0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9da3 expref: 13 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073980:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8000/0x4c16c38a9b6cec24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9da3 expref: 12 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.073998:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:0.0:1788869532.074000:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788869532.074003:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8000, rc 0) 00000100:00100000:0.0:1788869532.074073:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:11162:x1875765305052672:12345-192.168.204.54@tcp:101:bash.0 Request processed in 818us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869532.074080:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1788869532.078712:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869532.078809:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305052928 00000100:00100000:1.0:1788869532.078831:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305052928 00000100:00100000:1.0:1788869532.078898:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1788869532.078909:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:11162:x1875765305052928:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869532.078941:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869532.078962:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cec2b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9daa expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079076:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079092:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079103:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079171:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079180:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079186:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869532.079545:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788869532.079724:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079733:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079753:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079788:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079795:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.079802:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.082311:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869532.082319:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.082331:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.082351:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869532.082354:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869532.082360:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.082368:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cec32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869532.082394:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0f9434c reply state 00000000233426fd transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.082406:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.082432:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ecdb00) 00010000:00010000:1.0:1788869532.082435:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869532.082438:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788869532.083405:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cec2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9daa expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.083440:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9daa expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.083448:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ecda00) 00010000:00010000:1.0:1788869532.083451:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869532.083454:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f200, rc 0) 00000100:00100000:1.0:1788869532.083790:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11162:x1875765305052928:12345-192.168.204.54@tcp:101:bash.0 Request processed in 4881us (5087us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788869532.083799:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1788869532.108264:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869532.108458:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305053056 00000100:00100000:2.0:1788869532.108469:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305053056 00000100:00100000:2.0:1788869532.108531:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788869532.108541:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1875765305053056:12345-192.168.204.54@tcp:8:bash.0 00010000:00080000:2.0:1788869532.108580:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1788869532.108637:0:8440:0:(genops.c:1384:class_connect()) connect: client 91cba2f3-33fb-476e-a4a1-b4fbee1b176d, cookie 0x4c16c38a9b6cec4e 00002000:00100000:2.0:1788869532.108650:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 91cba2f3-33fb-476e-a4a1-b4fbee1b176d/ffff8e2704145800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869532.108660:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788869532.108738:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788869532.108772:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8e2704146800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869532.108847:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2406:x1875765305053056:12345-192.168.204.54@tcp:8:bash.0 Request processed in 305us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869532.108866:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788869532.112082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869532.112261:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305053184 00000100:00100000:1.0:1788869532.112272:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305053184 00000100:00100000:1.0:1788869532.112351:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1788869532.112363:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:0:x1875765305053184:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869532.112384:0:8743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869532.112411:0:8743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9db1 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869532.112438:0:8743:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869532.112457:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=466s v=(0 0) 00010000:00010000:1.0:1788869532.112462:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869532.112487:0:8743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db1 expref: 7 pid: 8743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.112521:0:8743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db1 expref: 7 pid: 8743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.112535:0:8743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e400, rc 0) 00000100:00100000:1.0:1788869532.112644:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:0:x1875765305053184:12345-192.168.204.54@tcp:101:bash.0 Request processed in 283us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869532.112655:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00080000:2.0:1788869532.114186:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869532.118480:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869532.121296:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305053312 00000100:00100000:0.0:1788869532.121315:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305053312 00000100:00100000:0.0:1788869532.121470:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788869532.121483:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:11162:x1875765305053312:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869532.121517:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869532.121539:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9db8 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.121614:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db1 expref: 8 pid: 8743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.121625:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869532.121629:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869532.121634:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.121679:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db1 expref: 8 pid: 8743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.121728:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db1 expref: 8 pid: 8743 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869532.121746:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1875765325083008:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869532.121876:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869532.125839:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869532.126009:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305053440 00000100:00100000:1.0:1788869532.126020:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305053440 00010000:00010000:1.0:1788869532.126066:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db1 expref: 9 pid: 8743 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869532.126114:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1788869532.126124:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28088b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2410:x1875765305053440:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869532.126141:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869532.126164:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db1 expref: 9 pid: 8743 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.126180:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db1 expref: 9 pid: 8743 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.126218:0:10401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869532.126222:0:10401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869532.126250:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 9 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.126266:0:10401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 9 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.126311:0:10401:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 9 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869532.126326:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10401:1875765325083136:192.168.204.54@tcp:105: 00000100:00100000:1.0:1788869532.126423:0:10401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca480 going to sleep for 11 seconds 00010000:00010000:3.0:1788869532.127093:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cec55 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db1 expref: 9 pid: 8743 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869532.127117:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1875765325083008:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869532.127145:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.127156:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8600, rc 0) 00000100:00100000:3.0:1788869532.127193:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:11162:x1875765305053312:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5712us (8723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.127201:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1788869532.133071:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10401:1875765325083136:192.168.204.54@tcp:105: 00010000:00010000:1.0:1788869532.133108:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869532.133185:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28088b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305053440:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 7062us (7355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869532.133198:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788869532.133749:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869532.133983:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305053696 00000100:00100000:2.0:1788869532.133992:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305053696 00000100:00100000:2.0:1788869532.134080:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788869532.134091:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11162:x1875765305053696:12345-192.168.204.54@tcp:35:bash.0 00000001:00080000:2.0:1788869532.134384:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:2.0:1788869532.134519:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:11162:x1875765305053696:12345-192.168.204.54@tcp:35:bash.0 Request processed in 430us (771us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788869532.134528:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000020:00080000:2.0:1788869532.134532:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788869532.254501:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869532.254692:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305053952 00000100:00100000:3.0:1788869532.254703:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305053952 00000100:00100000:3.0:1788869532.254775:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:3.0:1788869532.254791:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:11172:x1875765305053952:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869532.254820:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869532.254845:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cec63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9dbf expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869532.254984:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788869532.255106:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cec63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dbf expref: 19 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.255141:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecd700) 00010000:00010000:3.0:1788869532.255145:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869532.255151:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cec63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dbf expref: 19 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.255169:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe1000, rc 0) 00000100:00100000:3.0:1788869532.255477:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:11172:x1875765305053952:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 688us (988us total) trans 4294967316 rc 301/301 00000100:00100000:3.0:1788869532.255485:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1788869532.267803:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869532.268261:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305054208 00000100:00100000:2.0:1788869532.268272:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305054208 00000100:00100000:2.0:1788869532.268341:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788869532.268352:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:11172:x1875765305054208:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869532.268661:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:11172:x1875765305054208:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 310us (870us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788869532.268670:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788869532.345193:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869532.345430:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305054336 00000100:00100000:3.0:1788869532.345443:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305054336 00000100:00100000:3.0:1788869532.345523:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1788869532.345535:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:11178:x1875765305054336:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869532.345564:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869532.345635:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cec71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9dc6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.345713:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0400/0x4c16c38a9b6cec78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.345730:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0400/0x4c16c38a9b6cec78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.345746:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0400/0x4c16c38a9b6cec78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869532.345801:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788869532.345826:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869532.345851:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0400/0x4c16c38a9b6cec78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.345879:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cec71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dc6 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.345900:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0400/0x4c16c38a9b6cec78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dc6 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.345920:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:3.0:1788869532.345923:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869532.345926:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbe0400, rc 0) 00000100:00100000:3.0:1788869532.345990:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11178:x1875765305054336:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 458us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.346009:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1788869532.351427:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869532.351526:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305054592 00000100:00100000:2.0:1788869532.351537:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305054592 00000100:00100000:2.0:1788869532.351627:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1788869532.351639:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11178:x1875765305054592:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869532.351663:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869532.351690:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cec7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9dcd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.351811:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cec86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.351827:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cec86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.351840:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cec86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869532.351867:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788869532.352191:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cec7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dcd expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.352213:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cec86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dcd expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.352223:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ecda00) 00010000:00010000:2.0:1788869532.352226:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869532.352230:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda000, rc 0) 00000100:00100000:2.0:1788869532.352286:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:11178:x1875765305054592:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 649us (868us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788869532.352293:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:0.0:1788869532.356192:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869532.356242:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869532.356343:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305054720 00000100:00100000:3.0:1788869532.356355:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305054720 00000100:00100000:3.0:1788869532.356429:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788869532.356440:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:2410:x1875765305054720:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869532.356460:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869532.356502:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cec86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dcd expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.356522:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ecda00) 00010000:00010000:3.0:1788869532.356529:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869532.356628:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:2410:x1875765305054720:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 189us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.356661:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788869532.360726:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305054976 00000100:00100000:1.0:1788869532.360747:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305054976 00000100:00100000:1.0:1788869532.360883:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1788869532.360895:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:11178:x1875765305054976:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869532.360931:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869532.360959:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cec94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9dd4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.361125:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cec9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.361143:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cec9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.361157:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cec9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869532.361170:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788869532.361291:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cec94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dd4 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.361312:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cec9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dd4 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.361321:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ecda00) 00010000:00010000:1.0:1788869532.361324:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788869532.361327:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e000, rc 0) 00000100:00100000:1.0:1788869532.361402:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:11178:x1875765305054976:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 509us (5158us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788869532.361409:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1788869532.366432:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869532.366628:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305055104 00000100:00100000:0.0:1788869532.366638:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305055104 00000100:00100000:0.0:1788869532.366694:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1788869532.366705:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2409:x1875765305055104:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:0.0:1788869532.366760:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.366782:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.366792:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869532.366797:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869532.366802:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.366865:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.366881:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 7 pid: 8443 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869532.366901:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1875765325083264:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869532.368115:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869532.371011:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869532.371129:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1875765325083264:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869532.371165:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869532.371298:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305055232 00000100:00100000:3.0:1788869532.371307:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305055232 00002000:00100000:3.0:1788869532.371354:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8e270402c000 x1875765305055232/t0(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:478/0 lens 504/0 e 0 to 0 dl 1788869543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869532.371365:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e270402c000 with x1875765305055232 ext(0->12) 00010000:00010000:3.0:1788869532.371372:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 8 pid: 8443 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.371387:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 8 pid: 8443 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869532.371394:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e270402c000 00000100:00100000:3.0:1788869532.371427:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788869532.371437:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2409:x1875765305055232:12345-192.168.204.54@tcp:4:lfs.0 00000001:00100000:0.0:1788869532.373647:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000100:00100000:3.0:1788869532.374633:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2409:x1875765305055232:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 3188us (3639us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788869532.374646:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:3.0:1788869532.374658:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8e270402c000 x1875765305055232/t4294967300(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:478/0 lens 504/448 e 0 to 0 dl 1788869543 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869532.374668:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e270402c000 with x1875765305055232 ext(0->12) 00010000:00010000:3.0:1788869532.374678:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 9 pid: 8443 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.374716:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 9 pid: 8443 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869532.374724:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e270402c000 00000100:00100000:2.0:1788869532.383371:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869532.389091:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305055360 00000100:00100000:0.0:1788869532.389113:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305055360 00010000:00010000:0.0:1788869532.389190:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 9 pid: 8443 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869532.389235:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1788869532.389245:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2407:x1875765305055360:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869532.389263:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788869532.389282:0:6511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788869532.389285:0:6511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788869531 00002000:00010000:0.0:1788869532.389287:0:6511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788869531 00002000:00010000:0.0:1788869532.389289:0:6511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788869531 00002000:00010000:0.0:1788869532.389291:0:6511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788869532.389298:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 9 pid: 8443 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.389327:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 9 pid: 8443 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.389358:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cec5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9db8 expref: 9 pid: 8443 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.389375:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869532.389380:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869532.389385:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.389395:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.389431:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869532.389498:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2407:x1875765305055360:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 254us (6140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869532.389506:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00010000:00010000:2.0:1788869532.389664:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.389675:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.389694:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.389703:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.389722:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.389728:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869532.389733:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.389741:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.389754:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.389762:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa714dc/0x4c16c38a9b6ceca9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869532.389820:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2409:x1875765305055104:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 23117us (23400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869532.389828:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1788869532.395859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869532.395977:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305055616 00000100:00100000:2.0:1788869532.395987:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305055616 00000100:00100000:2.0:1788869532.396058:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788869532.396068:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:11178:x1875765305055616:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:2.0:1788869532.396141:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cec9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dd4 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869532.396389:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788869532.396427:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1788869532.396819:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:2.0:1788869532.396873:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.396889:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9daa expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.396897:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.396945:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9daa expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.396962:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9daa expref: 27 pid: 6525 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869532.396976:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875765325083392:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869532.397070:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27025a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869532.402755:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869532.405793:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305055744 00000100:00100000:1.0:1788869532.405812:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305055744 00010000:00010000:1.0:1788869532.405869:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9daa expref: 28 pid: 6525 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869532.405933:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:1.0:1788869532.405943:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+28:2410:x1875765305055744:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869532.405959:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869532.405966:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9daa expref: 28 pid: 6525 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.405982:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9daa expref: 28 pid: 6525 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.406012:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ecda00) 00010000:00010000:1.0:1788869532.406018:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.406029:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.406036:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869532.406068:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869532.406154:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+28:2410:x1875765305055744:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 213us (3411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869532.406172:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00010000:00010000:2.0:1788869532.408475:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cec40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9daa expref: 27 pid: 6525 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869532.408683:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875765325083392:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869532.408711:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.408744:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.408751:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869532.408878:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:2.0:1788869532.409026:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788869532.410671:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875765325083520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788869532.411445:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869532.411556:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27025a53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869532.412638:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325083520 00000100:00100000:1.0:1788869532.412664:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325083520 00000100:00100000:1.0:1788869532.412734:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788869532.412744:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875765325083520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788869532.412872:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875765325083520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 129us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869532.412879:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1788869532.414231:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869532.414880:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875765325083520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788869532.415118:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:2.0:1788869532.415234:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875765325083648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788869532.415298:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869532.415335:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27025a5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869532.415645:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325083648 00000100:00100000:1.0:1788869532.415654:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325083648 00000100:00100000:1.0:1788869532.415705:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788869532.415716:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1875765325083648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788869532.415866:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6527:x1875765325083648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 151us (567us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788869532.415875:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788869532.416013:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875765325083648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788869532.416284:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788869532.416323:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.416334:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.416342:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.416364:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869532.416369:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.416377:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.416392:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ecda00) 00010000:00010000:2.0:1788869532.416395:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788869532.416399:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.416405:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecb0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869532.417450:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788869532.417681:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788869532.417694:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 466331106736ns, next at 467331103641ns, rc = 0 00000001:00080000:2.0:1788869532.417706:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:2.0:1788869532.417747:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ecda00) 00010000:00010000:2.0:1788869532.417751:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788869532.417760:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cec9b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dd4 expref: 31 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869532.417926:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:11178:x1875765305055616:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 21858us (22079us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788869532.417936:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000020:00080000:2.0:1788869532.417941:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788869532.420922:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869532.421074:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305055872 00000100:00100000:0.0:1788869532.421085:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305055872 00000100:00100000:0.0:1788869532.421162:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:0.0:1788869532.421175:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:11178:x1875765305055872:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869532.421215:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869532.421241:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cecb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ddb expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.421339:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cecb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ddb expref: 31 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.421355:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cecb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ddb expref: 31 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869532.421374:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:0.0:1788869532.421377:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869532.421381:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8200, rc 0) 00000100:00100000:0.0:1788869532.421447:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+31:11178:x1875765305055872:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 274us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869532.421454:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:1.0:1788869532.428151:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869532.430404:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305056128 00000100:00100000:3.0:1788869532.430421:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305056128 00000100:00100000:3.0:1788869532.430540:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788869532.430550:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28268b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+31:11178:x1875765305056128:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869532.430828:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28268b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+32:11178:x1875765305056128:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 278us (2691us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788869532.430837:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788869532.555991:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869532.556251:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305056384 00000100:00100000:2.0:1788869532.556275:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305056384 00000100:00100000:2.0:1788869532.556337:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:2.0:1788869532.556347:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+32:11188:x1875765305056384:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869532.556376:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869532.556397:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9de2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869532.556510:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788869532.556882:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecbe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de2 expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.556897:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecd700) 00010000:00010000:2.0:1788869532.556900:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869532.556915:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cecbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de2 expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.556930:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda000, rc 0) 00000100:00100000:2.0:1788869532.556997:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:11188:x1875765305056384:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 651us (1019us total) trans 4294967330 rc 301/301 00000100:00100000:2.0:1788869532.557004:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1788869532.564689:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869532.565635:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305056512 00000100:00100000:3.0:1788869532.565653:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305056512 00000100:00100000:3.0:1788869532.565735:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1788869532.565747:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:11188:x1875765305056512:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1788869532.565846:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.565864:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.565877:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.565923:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.565932:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.565939:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566030:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566038:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566045:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869532.566100:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566115:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566122:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566131:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566138:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe1000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869532.566142:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566160:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566174:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:3.0:1788869532.566177:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869532.566184:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566191:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6ceccc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566208:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566215:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566221:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566226:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe0000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869532.566229:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566235:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566243:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ecdb00) 00010000:00010000:3.0:1788869532.566247:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869532.566250:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566267:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cecd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566278:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566285:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566292:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566297:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe0800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869532.566300:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566306:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566314:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869532.566316:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869532.566319:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.566324:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cecda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869532.566420:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:11188:x1875765305056512:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 673us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.566428:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1788869532.569434:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869532.569535:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305056768 00000100:00100000:2.0:1788869532.569548:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305056768 00000100:00100000:2.0:1788869532.569649:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1788869532.569660:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:11188:x1875765305056768:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869532.569938:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+34:11188:x1875765305056768:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 279us (518us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788869532.569964:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788869532.623705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869532.623801:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305057024 00000100:00100000:3.0:1788869532.623814:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305057024 00000100:00100000:3.0:1788869532.623884:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788869532.623895:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+34:11192:x1875765305057024:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869532.623934:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869532.623954:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cece1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9de9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624030:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624044:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624054:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624065:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624071:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624078:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624208:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624217:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624233:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869532.624244:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788869532.624320:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624328:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624335:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624341:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe0000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869532.624346:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624353:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624364:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:3.0:1788869532.624367:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869532.624371:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624377:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0000/0x4c16c38a9b6cece8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624391:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624395:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624408:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624412:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe1000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869532.624415:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624421:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624428:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ecdb00) 00010000:00010000:3.0:1788869532.624431:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869532.624434:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624440:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe1000/0x4c16c38a9b6cecef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624478:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0800/0x4c16c38a9b6cece1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de9 expref: 37 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624493:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de9 expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.624500:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869532.624501:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869532.624504:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9200, rc 0) 00000100:00100000:3.0:1788869532.624810:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:11192:x1875765305057024:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 915us (1116us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788869532.624826:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:0.0:1788869532.629044:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869532.629136:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305057152 00000100:00100000:2.0:1788869532.629151:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305057152 00000100:00100000:2.0:1788869532.629233:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:2.0:1788869532.629245:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:11192:x1875765305057152:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788869532.629338:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.629361:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.629377:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.629430:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.629438:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.629447:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.629454:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869532.629459:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.629468:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.629494:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869532.629511:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869532.629518:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.629524:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869532.629652:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:11192:x1875765305057152:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 408us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869532.629660:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1788869532.631676:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869532.631804:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305057408 00000100:00100000:3.0:1788869532.631815:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305057408 00000100:00100000:3.0:1788869532.631873:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788869532.631885:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:11192:x1875765305057408:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869532.632359:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+37:11192:x1875765305057408:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 474us (689us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788869532.632367:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000040:00080000:0.0:1788869532.870294:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788869532.870786:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869532.872069:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869532.999301:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869532.999326:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325083776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869532.999395:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869532.999747:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325083776 00000100:00100000:2.0:1788869532.999756:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325083776 00000100:00100000:2.0:1788869532.999809:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788869532.999819:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325083776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869532.999856:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1788869532.999926:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325083776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869532.999933:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788869533.000027:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325083776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869533.100361:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869533.100531:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305057664 00000100:00100000:2.0:1788869533.100548:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305057664 00000100:00100000:2.0:1788869533.100682:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1788869533.100694:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+37:11223:x1875765305057664:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788869533.100732:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869533.100766:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9df0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.100913:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6ced12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.100947:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6ced12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.100960:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6ced12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869533.100974:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00080000:1.0:1788869533.101312:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788869533.108969:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df0 expref: 40 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.109091:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6ced12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df0 expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.109103:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869533.109106:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869533.109551:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb200, rc 0) 00000100:00100000:2.0:1788869533.109849:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:11223:x1875765305057664:12345-192.168.204.54@tcp:101:cat.0 Request processed in 9153us (9497us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788869533.109860:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1788869533.115135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869533.115243:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869533.115616:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305058048 00000100:00100000:3.0:1788869533.115629:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305058048 00000100:00100000:3.0:1788869533.115805:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869533.115819:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:11223:x1875765305058048:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:3.0:1788869533.116408:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:11223:x1875765305058048:12345-192.168.204.54@tcp:35:cat.0 Request processed in 590us (1161us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788869533.116417:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788869533.117098:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305057792 00000100:00100000:2.0:1788869533.117109:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305057792 00000100:00100000:2.0:1788869533.117160:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788869533.117170:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:2407:x1875765305057792:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869533.117183:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869533.117210:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6ced12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df0 expref: 40 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.117251:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869533.117257:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869533.117292:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:2407:x1875765305057792:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 124us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869533.117300:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788869533.223911:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869533.225125:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305058304 00000100:00100000:2.0:1788869533.225141:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305058304 00000100:00100000:2.0:1788869533.225221:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1788869533.225232:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:11229:x1875765305058304:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1788869533.225259:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869533.225263:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788869533.225291:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbe0400/0x4c16c38a9b6cec78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dc6 expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.225311:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869533.225316:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869533.225330:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6ced20 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9df7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.225440:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.225455:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de9 expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.225464:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.225533:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de9 expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.225549:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de9 expref: 39 pid: 6526 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869533.225563:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325083904:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869533.225749:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27025a5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869533.229159:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869533.229262:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305058432 00000100:00100000:1.0:1788869533.229272:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305058432 00010000:00010000:1.0:1788869533.229315:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de9 expref: 40 pid: 6526 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869533.229358:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:1.0:1788869533.229368:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:2410:x1875765305058432:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869533.229400:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869533.229407:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de9 expref: 40 pid: 6526 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.229420:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de9 expref: 40 pid: 6526 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.229443:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869533.229449:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.229459:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.229467:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.229499:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869533.229555:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:2410:x1875765305058432:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 188us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869533.229563:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00010000:00010000:2.0:1788869533.230491:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cecf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9de9 expref: 39 pid: 6526 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869533.230512:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325083904:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869533.230533:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.230542:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.230547:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869533.230568:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788869533.230760:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6ced20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df7 expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.230776:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df7 expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.230799:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869533.230801:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869533.230805:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda000, rc 0) 00000100:00100000:2.0:1788869533.230861:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:11229:x1875765305058304:12345-192.168.204.54@tcp:101:dd.0 Request processed in 5631us (6976us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788869533.230868:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:3.0:1788869533.241105:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869533.241264:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305058560 00000100:00100000:1.0:1788869533.241279:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305058560 00000100:00100000:1.0:1788869533.241356:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1788869533.241369:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:11229:x1875765305058560:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:1.0:1788869533.241397:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869533.241421:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9dfe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.241497:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.241515:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.241528:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.241971:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dfe expref: 41 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.242067:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dfe expref: 40 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.242076:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869533.242079:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869533.242083:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f000, rc 0) 00000100:00100000:1.0:1788869533.242198:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:11229:x1875765305058560:12345-192.168.204.54@tcp:101:dd.0 Request processed in 832us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869533.242206:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1788869533.260721:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869533.260881:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305058816 00000100:00100000:3.0:1788869533.260904:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305058816 00000100:00100000:3.0:1788869533.260983:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1788869533.260994:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:11229:x1875765305058816:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:3.0:1788869533.261295:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.261313:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.261333:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869533.261376:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788869533.261401:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8e9d2f1 reply state 00000000ed57f707 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.261416:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.261424:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869533.261427:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869533.261432:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869533.261555:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:11229:x1875765305058816:12345-192.168.204.54@tcp:36:dd.0 Request processed in 562us (844us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788869533.261563:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000020:00080000:3.0:1788869533.261568:0:8260:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788869533.541948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869533.542063:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305058944 00000100:00100000:2.0:1788869533.542074:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305058944 00000100:00100000:2.0:1788869533.542183:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1788869533.542195:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:11243:x1875765305058944:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1788869533.542223:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869533.542245:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6ced4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e05 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542311:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542327:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542341:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542352:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542360:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542386:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542482:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542493:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df7 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542501:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.542535:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df7 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.543363:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df7 expref: 44 pid: 6524 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869533.543388:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325084032:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869533.543562:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27025a5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869533.548426:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325084032:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869533.548458:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869533.550000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869533.550296:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305059200 00000100:00100000:0.0:1788869533.550308:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305059200 00000100:00100000:0.0:1788869533.550370:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788869533.550381:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+45:6178:x1875765305059200:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788869533.550947:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+46:6178:x1875765305059200:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 566us (955us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1788869533.550957:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788869533.554837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869533.554947:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305059328 00000100:00100000:2.0:1788869533.554958:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305059328 00010000:00010000:2.0:1788869533.555010:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df7 expref: 46 pid: 6524 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869533.555086:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1788869533.555096:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+46:2409:x1875765305059328:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869533.555129:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869533.555137:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df7 expref: 46 pid: 6524 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.555151:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df7 expref: 46 pid: 6524 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.555178:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6ced27 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9df7 expref: 46 pid: 6524 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.555199:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869533.555204:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.555215:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.555224:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869533.555259:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869533.555330:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+45:2409:x1875765305059328:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 235us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869533.555338:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00010000:00010000:1.0:1788869533.556491:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556505:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869533.556710:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788869533.556715:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869533.556764:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556781:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556793:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556800:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556807:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556813:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869533.556817:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556825:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556838:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869533.556841:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869533.556846:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556851:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ced51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556877:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556896:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556903:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556908:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869533.556911:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556918:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556926:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ecdb00) 00010000:00010000:1.0:1788869533.556928:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869533.556931:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556937:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ced58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556981:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6ced4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e05 expref: 45 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.556997:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e05 expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.557014:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869533.557017:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869533.557020:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edae00, rc 0) 00000100:00100000:1.0:1788869533.557099:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+44:11243:x1875765305058944:12345-192.168.204.54@tcp:101:stat.0 Request processed in 14906us (15163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869533.557107:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1788869533.666342:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869533.666440:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305059584 00000100:00100000:3.0:1788869533.666452:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305059584 00000100:00100000:3.0:1788869533.666540:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788869533.666552:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+44:11249:x1875765305059584:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:3.0:1788869533.666650:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869533.666680:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ced5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e05 expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.666701:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869533.666707:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869533.666905:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.666934:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.666946:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869533.666994:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:3.0:1788869533.667015:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000031b43c7 reply state 00000000d508c06f transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.667028:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.667035:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869533.667037:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869533.667040:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869533.667167:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+46:11249:x1875765305059584:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 616us (833us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788869533.667175:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000020:00080000:3.0:1788869533.667180:0:8260:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788869533.894250:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869533.912076:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869533.912198:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305059712 00000100:00100000:1.0:1788869533.912210:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305059712 00000100:00100000:1.0:1788869533.912284:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788869533.912294:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+46:11263:x1875765305059712:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:1.0:1788869533.912321:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869533.912342:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6ced6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e0c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912423:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912439:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912450:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912474:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912483:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912502:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912614:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912624:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912632:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869533.912676:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788869533.912680:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869533.912698:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912712:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912719:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912724:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912731:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912736:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869533.912740:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912754:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912766:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869533.912769:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869533.912774:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912780:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ced74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912793:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912799:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912804:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912810:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869533.912812:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912818:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912824:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ecdb00) 00010000:00010000:1.0:1788869533.912826:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869533.912828:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912843:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912870:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6ced6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e0c expref: 48 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912896:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e0c expref: 47 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869533.912903:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869533.912906:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869533.912908:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ea00, rc 0) 00000100:00100000:1.0:1788869533.912984:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+47:11263:x1875765305059712:12345-192.168.204.54@tcp:101:stat.0 Request processed in 691us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869533.912992:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788869534.021969:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869534.025844:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2809e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325084288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869534.025952:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869534.026697:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325084160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869534.026740:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869534.048495:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325084288 00000100:00100000:2.0:1788869534.048519:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325084288 00000100:00100000:2.0:1788869534.048677:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325084160 00000100:00100000:2.0:1788869534.048682:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325084160 00000100:00100000:2.0:1788869534.048713:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788869534.048724:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325084288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869534.048763:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788869534.048957:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869534.049119:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788869534.049131:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325084160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869534.049145:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869534.055227:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325084160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6083us (28468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869534.055246:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788869534.055361:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2809e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325084288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869534.055365:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325084288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6487us (29257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869534.055378:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788869534.055408:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325084160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869534.063268:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.063640:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305059968 00000100:00100000:3.0:1788869534.063653:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305059968 00000100:00100000:3.0:1788869534.064220:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1788869534.064238:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+47:11273:x1875765305059968:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869534.064264:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869534.064401:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6ced89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e13 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869534.068388:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788869534.069074:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6ced89 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e13 expref: 49 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.069099:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecd700) 00010000:00010000:3.0:1788869534.069102:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869534.069109:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6ced89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e13 expref: 49 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.069130:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8c00, rc 0) 00000100:00100000:3.0:1788869534.069232:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+48:11273:x1875765305059968:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 4999us (5975us total) trans 4294967342 rc 301/301 00000100:00100000:3.0:1788869534.069243:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:0.0:1788869534.074041:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869534.074136:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305060224 00000100:00100000:2.0:1788869534.074149:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305060224 00000100:00100000:2.0:1788869534.074239:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1788869534.074252:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+48:11273:x1875765305060224:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869534.074683:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+49:11273:x1875765305060224:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 432us (652us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788869534.074691:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1788869534.183083:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869534.184953:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305060480 00000100:00100000:1.0:1788869534.184970:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305060480 00000100:00100000:1.0:1788869534.185055:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788869534.185067:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+49:11279:x1875765305060480:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869534.185092:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869534.185114:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6ced97 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e1a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.185306:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.186442:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e0c expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.186458:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.186516:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e0c expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.186533:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e0c expref: 50 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869534.187001:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325084416:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869534.187190:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0cacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869534.199340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.200056:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305060608 00000100:00100000:3.0:1788869534.200070:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305060608 00010000:00010000:3.0:1788869534.200127:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e0c expref: 51 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869534.200223:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788869534.200235:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+51:2409:x1875765305060608:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869534.200255:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869534.200264:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e0c expref: 51 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.200277:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e0c expref: 51 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.200306:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869534.200312:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.200333:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.200341:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.200363:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869534.200427:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+51:2409:x1875765305060608:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 193us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869534.200434:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00010000:00010000:1.0:1788869534.200858:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ced82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e0c expref: 50 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869534.200890:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325084416:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869534.200912:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.200921:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.200939:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869534.200958:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788869534.201112:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6ced97 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e1a expref: 51 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.201129:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e1a expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.201136:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869534.201139:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869534.201142:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f400, rc 0) 00000100:00100000:1.0:1788869534.201178:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+50:11279:x1875765305060480:12345-192.168.204.54@tcp:101:bash.0 Request processed in 16114us (18108us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788869534.201185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:0.0:1788869534.213828:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869534.214802:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305060864 00000100:00100000:2.0:1788869534.214815:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305060864 00000100:00100000:2.0:1788869534.214894:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1788869534.214905:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+50:11279:x1875765305060864:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1788869534.215158:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.215176:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.215189:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869534.215250:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:2.0:1788869534.215272:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000806f6141 reply state 000000000893772e transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.215284:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.215292:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869534.215296:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869534.215300:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869534.215397:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:11279:x1875765305060864:12345-192.168.204.54@tcp:36:bash.0 Request processed in 494us (1582us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788869534.215405:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000020:00080000:2.0:1788869534.215410:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788869534.228343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869534.229721:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305060992 00000100:00100000:2.0:1788869534.229736:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305060992 00000100:00100000:2.0:1788869534.229828:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:2.0:1788869534.229840:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:11279:x1875765305060992:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869534.229882:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869534.229908:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cedb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e21 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.230036:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.230054:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e1a expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.230075:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.230119:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e1a expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.230134:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e1a expref: 54 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869534.230150:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325084544:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869534.230251:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27025a5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869534.233245:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869534.233345:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305061120 00000100:00100000:1.0:1788869534.233354:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305061120 00010000:00010000:1.0:1788869534.233398:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e1a expref: 55 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869534.233438:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1788869534.233449:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:2410:x1875765305061120:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869534.233469:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869534.233476:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e1a expref: 55 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.233507:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e1a expref: 55 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.233529:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869534.233534:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.233660:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.233669:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.233780:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869534.233835:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:2410:x1875765305061120:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 388us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869534.233844:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00010000:00010000:2.0:1788869534.234856:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ced9e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e1a expref: 54 pid: 6526 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869534.234888:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325084544:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869534.234914:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.234922:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.234928:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869534.234984:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788869534.234988:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869534.235008:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.235055:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cedb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e21 expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.235068:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e21 expref: 53 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.235076:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869534.235078:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869534.235082:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda800, rc 0) 00000100:00100000:2.0:1788869534.235183:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:11279:x1875765305060992:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5346us (6853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869534.235190:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1788869534.242139:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869534.242318:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305061376 00000100:00100000:2.0:1788869534.242329:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305061376 00000100:00100000:2.0:1788869534.242394:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788869534.242407:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28268b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:11279:x1875765305061376:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1788869534.243006:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28268b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+54:11279:x1875765305061376:12345-192.168.204.54@tcp:35:bash.0 Request processed in 600us (877us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788869534.243015:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1788869534.308546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.308804:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305061632 00000100:00100000:3.0:1788869534.308819:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305061632 00000100:00100000:3.0:1788869534.308896:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:3.0:1788869534.308907:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+54:11289:x1875765305061632:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869534.308949:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869534.308981:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cedc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e28 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869534.309094:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788869534.309322:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cedc1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e28 expref: 56 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.309336:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecd700) 00010000:00010000:3.0:1788869534.309339:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869534.309344:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cedc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e28 expref: 56 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.309359:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8c00, rc 0) 00000100:00100000:3.0:1788869534.309422:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:11289:x1875765305061632:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 517us (889us total) trans 4294967348 rc 301/301 00000100:00100000:3.0:1788869534.309429:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:3.0:1788869534.312283:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869534.312433:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305061760 00000100:00100000:1.0:1788869534.312444:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305061760 00000100:00100000:1.0:1788869534.312512:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1788869534.312522:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:11289:x1875765305061760:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1788869534.312633:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312651:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312665:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312752:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312761:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312768:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312885:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312895:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312903:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869534.312962:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312977:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312984:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312991:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.312997:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869534.313001:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313015:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313029:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869534.313032:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869534.313038:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313044:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cedcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313058:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313063:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313069:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313075:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ea00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869534.313078:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313084:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313091:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ecdb00) 00010000:00010000:1.0:1788869534.313093:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869534.313096:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313113:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cedd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313124:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313130:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313137:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313142:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869534.313145:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313151:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313158:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869534.313160:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869534.313162:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.313181:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceddd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869534.313275:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:11289:x1875765305061760:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 753us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869534.313283:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:0.0:1788869534.316772:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.316860:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305062016 00000100:00100000:3.0:1788869534.316881:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305062016 00000100:00100000:3.0:1788869534.316937:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1788869534.316948:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:11289:x1875765305062016:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869534.317219:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+56:11289:x1875765305062016:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 272us (540us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788869534.317227:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788869534.360706:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.360857:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305062272 00000100:00100000:3.0:1788869534.360899:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305062272 00000100:00100000:3.0:1788869534.360979:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:3.0:1788869534.360991:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+56:11292:x1875765305062272:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869534.361022:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869534.361050:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cede4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e2f expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361158:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361175:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361188:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361199:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361207:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361213:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361328:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cedf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361339:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cedf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361347:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cedf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869534.361363:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788869534.361442:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361463:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361471:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361477:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869534.361481:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361489:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361500:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:3.0:1788869534.361503:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869534.361508:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361514:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cedeb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361526:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361532:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361548:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361553:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869534.361556:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361563:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361571:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ecdb00) 00010000:00010000:3.0:1788869534.361573:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869534.361575:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361581:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cedf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361664:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cede4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e2f expref: 59 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361678:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cedf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e2f expref: 58 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.361685:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869534.361687:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869534.361690:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9c00, rc 0) 00000100:00100000:3.0:1788869534.361743:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:11292:x1875765305062272:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 755us (1050us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788869534.361758:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1788869534.366934:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869534.366985:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.367063:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305062528 00000100:00100000:3.0:1788869534.367075:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305062528 00000100:00100000:3.0:1788869534.367163:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788869534.367174:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:2408:x1875765305062528:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869534.367198:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869534.367232:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cedf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e2f expref: 58 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.367256:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869534.367263:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869534.367335:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:2408:x1875765305062528:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 162us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869534.367342:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788869534.367734:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305062400 00000100:00100000:1.0:1788869534.367740:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305062400 00000100:00100000:1.0:1788869534.367778:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:1.0:1788869534.367786:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:11292:x1875765305062400:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788869534.367847:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.367863:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.367885:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.367921:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.367928:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.367936:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.367942:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869534.367946:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.367953:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.367961:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869534.367964:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869534.367969:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.367994:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cee07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869534.368042:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:11292:x1875765305062400:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 257us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869534.368048:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1788869534.371978:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.372094:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305062784 00000100:00100000:3.0:1788869534.372107:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305062784 00000100:00100000:3.0:1788869534.372184:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788869534.372194:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:11292:x1875765305062784:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869534.372431:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:11292:x1875765305062784:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 237us (473us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788869534.372440:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1788869534.562054:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.562180:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305063040 00000100:00100000:3.0:1788869534.562190:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305063040 00000100:00100000:3.0:1788869534.562252:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:3.0:1788869534.562261:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:11310:x1875765305063040:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1788869534.562300:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869534.562321:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e36 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.562430:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cee15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.562447:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cee15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.562459:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cee15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869534.562471:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788869534.562739:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e36 expref: 61 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.562759:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cee15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e36 expref: 60 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.562767:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869534.562770:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788869534.562774:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8c00, rc 0) 00000100:00100000:3.0:1788869534.562847:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:11310:x1875765305063040:12345-192.168.204.54@tcp:101:cat.0 Request processed in 587us (804us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788869534.562855:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000001:00080000:0.0:1788869534.565914:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1788869534.565988:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788869534.566149:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566162:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566170:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566194:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869534.566199:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566208:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566225:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e28029d9b00) 00010000:00010000:2.0:1788869534.566228:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869534.566233:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566240:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cebf3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566263:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566269:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566275:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566280:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869534.566283:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566288:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566307:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869534.566309:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869534.566312:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566317:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cebfa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566332:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566338:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566343:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566348:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869534.566350:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566355:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566362:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ecdb00) 00010000:00010000:2.0:1788869534.566364:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869534.566367:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566372:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cec39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566411:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566417:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566423:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566428:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869534.566431:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566437:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566457:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869534.566460:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869534.566463:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566469:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6ced43 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566479:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566485:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566490:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566505:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869534.566508:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566515:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566525:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869534.566527:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869534.566529:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566535:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6ced66 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566548:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566554:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566560:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566564:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869534.566567:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566572:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566636:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:2.0:1788869534.566638:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869534.566641:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.566647:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cedac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869534.567047:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869534.567072:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325084672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788869534.567148:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869534.567373:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325084672 00000100:00100000:1.0:1788869534.567382:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325084672 00000100:00100000:1.0:1788869534.567456:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869534.567467:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3649:x1875765325084672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788869534.567495:0:11338:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788869534.567534:0:11338:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ffb9b, atime: 0x6a9ffb9b, ctime: 0x6a9ffb9b, blocks: 0x8 00010000:00010000:1.0:1788869534.567542:0:11338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.567557:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788869534.567561:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869534.567567:0:11338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.567582:0:11338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.567618:0:11338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.567640:0:11338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.567660:0:11338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788869534.567833:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325084672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 367us (684us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788869534.567841:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788869534.567889:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869534.567895:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.567904:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ea00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869534.567908:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.567917:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.567930:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.567938:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cee23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788869534.568069:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788869534.568146:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e270417f100/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788869534.568153:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325084672:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788869534.568200:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869534.568210:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869534.568212:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788869534.568469:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e27025a53c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788869534.568475:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2804fe8600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e27025a5e40 00000020:00080000:0.0:1788869534.568479:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2804fe8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2701f37a00 00000020:00080000:2.0:1788869534.568574:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788869534.568826:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788869534.597391:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869534.597507:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305063168 00000100:00100000:1.0:1788869534.597520:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305063168 00000100:00100000:2.0:1788869534.598024:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:2.0:1788869534.598039:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11311:x1875765305063168:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869534.598064:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869534.598085:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cee2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e3d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.598161:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cee31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.598177:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cee31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.598190:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cee31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869534.598239:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788869534.598244:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869534.598266:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cee31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.598313:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cee2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e3d expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.598335:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cee31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e3d expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.598344:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869534.598347:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869534.598352:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb800, rc 0) 00000100:00100000:2.0:1788869534.598816:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11311:x1875765305063168:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 778us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869534.598824:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:1.0:1788869534.609470:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.609560:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305063552 00000100:00100000:3.0:1788869534.609572:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305063552 00000100:00100000:3.0:1788869534.609673:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788869534.609696:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11311:x1875765305063552:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869534.610016:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11311:x1875765305063552:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 333us (560us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788869534.610024:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788869534.614365:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869534.614619:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305063680 00000100:00100000:1.0:1788869534.614631:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305063680 00000100:00100000:1.0:1788869534.614721:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788869534.614732:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11311:x1875765305063680:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:1.0:1788869534.614751:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788869534.614779:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cedba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e21 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.614804:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cee15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e36 expref: 14 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.614819:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cecb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ddb expref: 13 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.614829:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869534.614835:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869534.615290:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:11311:x1875765305063680:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 556us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869534.615300:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788869534.621264:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869534.621465:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305063808 00000100:00100000:2.0:1788869534.621477:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305063808 00000100:00100000:2.0:1788869534.621619:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:2.0:1788869534.621634:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:11311:x1875765305063808:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:2.0:1788869534.621817:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.621836:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.621849:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869534.622125:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869534.622300:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788869534.622377:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788869534.622466:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:11311:x1875765305063808:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 835us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869534.622475:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:2.0:1788869534.655103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869534.655218:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305063936 00000100:00100000:1.0:1788869534.655229:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305063936 00000100:00100000:1.0:1788869534.655288:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788869534.655298:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:11313:x1875765305063936:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869534.655340:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869534.655364:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cee3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e44 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655439:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655468:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655480:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655497:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655503:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655509:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655642:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655652:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655660:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869534.655710:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788869534.655720:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869534.655746:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655758:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655766:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655772:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655779:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655784:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869534.655789:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655797:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655809:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869534.655812:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869534.655817:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655824:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cee46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655840:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655856:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655872:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655877:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869534.655880:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655886:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655894:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ecd100) 00010000:00010000:1.0:1788869534.655897:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869534.655899:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655905:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cee4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655958:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cee3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e44 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655971:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e44 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869534.655978:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869534.655981:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869534.655991:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e800, rc 0) 00000100:00100000:1.0:1788869534.656067:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11313:x1875765305063936:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 769us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869534.656075:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00010000:00010000:3.0:1788869534.919957:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869534.921747:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869534.921757:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869534.921808:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788869534.921815:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869534.922124:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2809e39f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325084800:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869534.922256:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869534.940705:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2809e39f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325084800:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869534.950385:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.950486:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305064064 00000100:00100000:3.0:1788869534.950498:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305064064 00000100:00100000:3.0:1788869534.950612:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:3.0:1788869534.950632:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11324:x1875765305064064:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788869534.950673:0:8260:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788869534.950803:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11324:x1875765305064064:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 181us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869534.950830:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1788869534.957985:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.958144:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305064192 00000100:00100000:3.0:1788869534.958160:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305064192 00000100:00100000:3.0:1788869534.958227:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:3.0:1788869534.958240:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11324:x1875765305064192:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788869534.958317:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958337:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958350:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958365:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958373:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958380:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958408:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958417:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958424:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869534.958501:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788869534.958507:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869534.958533:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958547:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958555:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958563:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958569:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9c00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869534.958573:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958582:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958625:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:3.0:1788869534.958628:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869534.958634:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958640:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cee5b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958654:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958670:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958677:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958681:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869534.958684:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958692:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958700:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8e270365c600) 00010000:00010000:3.0:1788869534.958703:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869534.958706:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958711:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee62 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958725:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958731:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958736:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958740:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869534.958747:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958754:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958760:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869534.958763:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869534.958766:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.958771:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869534.958845:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11324:x1875765305064192:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 608us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869534.958853:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:0.0:1788869534.965401:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.965698:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305064448 00000100:00100000:3.0:1788869534.965711:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305064448 00000100:00100000:3.0:1788869534.965785:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:3.0:1788869534.965796:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11324:x1875765305064448:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869534.965819:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869534.965843:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cee70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e4b expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966102:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966121:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966155:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869534.966169:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788869534.966255:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966264:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966272:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966278:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869534.966283:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966291:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966304:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869534.966306:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869534.966312:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966318:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cee77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966365:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cee70 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e4b expref: 15 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966386:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:3.0:1788869534.966389:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869534.966393:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cee70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e4b expref: 15 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.966403:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8a00, rc 0) 00000100:00100000:3.0:1788869534.966619:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11324:x1875765305064448:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 824us (1232us total) trans 4294967354 rc 301/301 00000100:00100000:3.0:1788869534.966628:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:2.0:1788869534.975172:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.975419:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305064576 00000100:00100000:3.0:1788869534.975444:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305064576 00000100:00100000:3.0:1788869534.978611:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1788869534.978639:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11324:x1875765305064576:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788869534.978684:0:6526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788869534.978843:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11324:x1875765305064576:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 215us (3684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869534.986748:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:1.0:1788869534.986842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869534.987611:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305064832 00000100:00100000:3.0:1788869534.987621:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305064832 00000100:00100000:3.0:1788869534.987672:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:3.0:1788869534.987685:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11324:x1875765305064832:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869534.987710:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869534.987714:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788869534.987742:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cee31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e3d expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.987783:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:3.0:1788869534.987788:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869534.987804:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee85 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e52 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788869534.988717:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788869534.988898:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.988915:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.988925:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.989070:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cee85 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e52 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.989091:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e52 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869534.989099:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e270365c600) 00010000:00010000:3.0:1788869534.989102:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869534.989105:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9600, rc 0) 00000100:00100000:3.0:1788869534.989368:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11324:x1875765305064832:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1685us (2525us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788869534.989378:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:3.0:1788869534.993120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869534.993269:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305065088 00000100:00100000:2.0:1788869534.993280:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305065088 00000100:00100000:2.0:1788869534.993344:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:2.0:1788869534.993355:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11324:x1875765305065088:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869534.993416:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869534.993461:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cee8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e52 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993481:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e270365c600) 00010000:00010000:2.0:1788869534.993493:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869534.993519:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993533:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993544:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993641:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993651:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993678:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993733:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993740:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993746:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993752:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869534.993756:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993763:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993771:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869534.993774:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869534.993778:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993785:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cee9a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993795:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993801:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993813:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993819:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869534.993822:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993829:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993837:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc67e40c9 (ffff8e280839c300) 00010000:00010000:2.0:1788869534.993839:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869534.993841:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869534.993847:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6ceea1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc67e40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869534.993946:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11324:x1875765305065088:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 593us (848us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869534.993953:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:3.0:1788869535.001462:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.001615:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305065216 00000100:00100000:0.0:1788869535.001628:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305065216 00000100:00100000:0.0:1788869535.001689:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:0.0:1788869535.001699:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11324:x1875765305065216:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869535.001719:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869535.001744:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6ceea8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e59 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.001783:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.001798:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.001809:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.001947:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6ceea8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e59 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.002554:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e59 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.002564:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:0.0:1788869535.002567:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869535.002571:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a9600, rc 0) 00000100:00100000:0.0:1788869535.002669:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11324:x1875765305065216:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 970us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869535.002676:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:2.0:1788869535.011345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869535.012015:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305065472 00000100:00100000:3.0:1788869535.012030:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305065472 00000100:00100000:3.0:1788869535.012128:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1788869535.012139:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11324:x1875765305065472:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869535.012234:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.012256:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.012269:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788869535.012526:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788869535.012701:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788869535.012714:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 468926125953ns, next at 469926123048ns, rc = 0 00000004:00010000:3.0:1788869535.012767:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc406991 reply state 00000000494efe61 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.012782:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.012790:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:3.0:1788869535.012793:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788869535.012797:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869535.012965:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:11324:x1875765305065472:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 826us (1630us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788869535.012974:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1788869535.024662:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.024782:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305065600 00000100:00100000:1.0:1788869535.024792:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305065600 00000100:00100000:1.0:1788869535.024848:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:1.0:1788869535.024872:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:11324:x1875765305065600:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869535.024900:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869535.024927:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.025005:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e60 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.025020:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e60 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.025039:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:1.0:1788869535.025042:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869535.025047:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f400, rc 0) 00000100:00100000:1.0:1788869535.025113:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:11324:x1875765305065600:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 256us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.025120:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:3.0:1788869535.030950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.031219:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305065728 00000100:00100000:0.0:1788869535.031232:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305065728 00000100:00100000:0.0:1788869535.031286:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788869535.031297:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875765305065728:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788869535.031336:0:8443:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1788869535.031389:0:8443:0:(genops.c:1384:class_connect()) connect: client 91cba2f3-33fb-476e-a4a1-b4fbee1b176d, cookie 0x4c16c38a9b6ceec4 00002000:00100000:0.0:1788869535.031404:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 91cba2f3-33fb-476e-a4a1-b4fbee1b176d/ffff8e281127a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788869535.031447:0:8443:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788869535.031539:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788869535.031574:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8e281127f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869535.031661:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2406:x1875765305065728:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 Request processed in 364us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869535.031668:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1788869535.045775:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869535.045802:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325084928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869535.045884:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869535.045969:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325084928 00000100:00100000:2.0:1788869535.045978:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325084928 00000100:00100000:2.0:1788869535.046031:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788869535.046055:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325084928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869535.046097:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869535.046196:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325084928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869535.046203:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788869535.046260:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325084928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869535.046737:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869535.046799:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305065856 00000100:00100000:3.0:1788869535.046805:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305065856 00000100:00100000:3.0:1788869535.046871:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1788869535.046880:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:0:x1875765305065856:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788869535.047238:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788869535.050326:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1788869535.050349:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000100:00100000:3.0:1788869535.050784:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:0:x1875765305065856:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 3899us (4045us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788869535.050795:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1788869535.072964:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869535.073077:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305066112 00000100:00100000:2.0:1788869535.073089:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305066112 00000100:00100000:2.0:1788869535.073152:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788869535.073164:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:11324:x1875765305066112:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788869535.073418:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:11324:x1875765305066112:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 257us (465us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788869535.073426:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788869535.081358:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.085928:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305066368 00000100:00100000:1.0:1788869535.085973:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305066368 00000100:00100000:1.0:1788869535.086041:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1788869535.086053:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:11324:x1875765305066368:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869535.086192:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:11324:x1875765305066368:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 140us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.086199:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:0.0:1788869535.098397:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.098523:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305066496 00000100:00100000:1.0:1788869535.098533:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305066496 00000100:00100000:1.0:1788869535.098621:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:1.0:1788869535.098632:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:11324:x1875765305066496:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869535.098656:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869535.098678:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6ceecb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e67 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.098791:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ceed2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.098807:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ceed2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.098822:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ceed2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869535.098881:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869535.098903:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ceed2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.098932:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6ceecb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e67 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.098965:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ceed2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e67 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.098974:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:1.0:1788869535.098977:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788869535.098981:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ea00, rc 0) 00000100:00100000:1.0:1788869535.099039:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11324:x1875765305066496:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 409us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.099046:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:1.0:1788869535.105200:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.105274:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305066624 00000100:00100000:0.0:1788869535.105288:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305066624 00000100:00100000:0.0:1788869535.105358:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788869535.105368:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305066624:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869535.105387:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869535.105428:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e6e expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869535.105463:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffb9d, blocks: 0x0 00010000:00010000:0.0:1788869535.105483:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1788869535.105487:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869535.105497:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e6e expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.105517:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e6e expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.105531:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8600, rc 0) 00000100:00100000:0.0:1788869535.105609:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305066624:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 218us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869535.105617:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788869535.112797:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.115772:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305066880 00000100:00100000:1.0:1788869535.115795:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305066880 00000100:00100000:1.0:1788869535.116996:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:1.0:1788869535.117013:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11324:x1875765305066880:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869535.117161:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11324:x1875765305066880:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 154us (4376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.117169:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:0.0:1788869535.139137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.144561:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305067008 00000100:00100000:1.0:1788869535.144583:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305067008 00000100:00100000:1.0:1788869535.144672:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788869535.144683:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:11324:x1875765305067008:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869535.144703:0:8743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869535.144726:0:8743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e75 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.144780:0:8743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e6e expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.144789:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869535.144794:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869535.144798:0:8743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 7 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.144835:0:8743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e6e expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.144850:0:8743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e6e expref: 7 pid: 8440 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.144877:0:8743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8743:1875765325085056:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869535.145259:0:8743:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869535.149078:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.149192:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305067136 00000100:00100000:0.0:1788869535.149202:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305067136 00010000:00010000:0.0:1788869535.149247:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e6e expref: 8 pid: 8440 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.149295:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1788869535.149306:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305067136:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869535.149319:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869535.149350:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e6e expref: 8 pid: 8440 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.149363:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e6e expref: 8 pid: 8440 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.149392:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869535.149397:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869535.149539:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 8 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.149554:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 8 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.149623:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 8 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.149641:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875765325085184:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788869535.149719:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a280c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788869535.151979:0:8743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b225a37a/0x4c16c38a9b6ceed9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e6e expref: 8 pid: 8440 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869535.152007:0:8743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8743:1875765325085056:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869535.152040:0:8743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 7 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.152053:0:8743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e400, rc 0) 00000100:00100000:2.0:1788869535.152325:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:11324:x1875765305067008:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 7639us (13197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869535.152335:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1788869535.152563:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875765325085184:192.168.204.54@tcp:105: 00010000:00010000:2.0:1788869535.152580:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869535.152647:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305067136:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3343us (3582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869535.152657:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1788869535.158890:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.159072:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305067264 00000100:00100000:0.0:1788869535.159086:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305067264 00002000:00100000:0.0:1788869535.159142:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8e270402ce00 x1875765305067264/t0(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:481/0 lens 504/0 e 0 to 0 dl 1788869546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788869535.159154:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e270402ce00 with x1875765305067264 ext(0->8) 00002000:00010000:0.0:1788869535.159160:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e270402ce00 00000100:00100000:0.0:1788869535.159195:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788869535.159214:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305067264:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788869535.160543:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2407:x1875765305067264:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 1323us (1655us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788869535.160555:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:0.0:1788869535.160565:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8e270402ce00 x1875765305067264/t4294967303(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:481/0 lens 504/448 e 0 to 0 dl 1788869546 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788869535.160576:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e270402ce00 with x1875765305067264 ext(0->8) 00002000:00010000:0.0:1788869535.160581:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e270402ce00 00000100:00100000:0.0:1788869535.163962:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.164010:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.164042:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.164061:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.164083:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.164110:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305067904 00000100:00100000:0.0:1788869535.164120:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305067904 00000100:00100000:0.0:1788869535.164178:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305067520 00000100:00100000:0.0:1788869535.164181:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305067520 00000100:00100000:0.0:1788869535.164197:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305067776 00000100:00100000:0.0:1788869535.164199:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305067776 00000100:00100000:0.0:1788869535.164219:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 324 00000100:00100000:0.0:1788869535.164228:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305067904:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869535.164303:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305067904:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869535.164311:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 324 00000100:00100000:0.0:1788869535.164331:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 325 00000100:00100000:0.0:1788869535.164338:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305067520:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869535.164374:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305067520:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869535.164381:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 325 00000100:00100000:0.0:1788869535.164394:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 326 00000100:00100000:0.0:1788869535.164402:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305067776:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869535.164423:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305067776:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869535.164429:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 326 00000100:00080000:0.0:1788869535.164460:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869535.164465:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869535.164677:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305067392 00000100:00100000:1.0:1788869535.164683:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305067392 00000100:00100000:1.0:1788869535.164715:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 390 00000100:00100000:1.0:1788869535.164722:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305067392:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869535.164755:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305067392:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.164761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 390 00000100:00100000:3.0:1788869535.165059:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305067648 00000100:00100000:3.0:1788869535.165064:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305067648 00000100:00100000:3.0:1788869535.165115:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:3.0:1788869535.165122:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2408:x1875765305067648:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869535.165153:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2408:x1875765305067648:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869535.165159:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00080000:1.0:1788869535.165210:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869535.168200:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869535.168291:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305068032 00000100:00100000:3.0:1788869535.168301:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305068032 00000100:00100000:3.0:1788869535.168402:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:3.0:1788869535.168423:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11324:x1875765305068032:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788869535.171615:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:0.0:1788869535.171634:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788869535.171656:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788869535.171676:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788869535.171685:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788869535.171828:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869535.171860:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325085312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788869535.171933:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869535.172083:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11324:x1875765305068032:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 3669us (3893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869535.172092:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1788869535.172835:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325085312 00000100:00100000:0.0:1788869535.172845:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325085312 00000100:00100000:0.0:1788869535.172900:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788869535.172910:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325085312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788869535.173045:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788869535.173049:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788869534 00002000:00010000:0.0:1788869535.173052:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788869535.173054:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788869533 -> 1788869534 00002000:00010000:0.0:1788869535.173057:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788869535.173108:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325085312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (1175us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788869535.173128:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1788869535.174387:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e270402d500/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788869535.174398:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325085312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788869535.174838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869535.174908:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305068160 00000100:00100000:3.0:1788869535.174914:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305068160 00000100:00100000:3.0:1788869535.174971:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1788869535.174981:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2409:x1875765305068160:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788869535.176742:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.176761:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.176770:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.176777:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869535.176782:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.176790:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.176807:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:1.0:1788869535.176810:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788869535.176815:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.176821:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6ceeb6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869535.178213:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788869535.178227:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788869535.178374:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305068160:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 3388us (3532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.178385:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1788869535.181345:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869535.182335:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305068416 00000100:00100000:3.0:1788869535.182348:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305068416 00000100:00100000:3.0:1788869535.182473:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:3.0:1788869535.182485:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11324:x1875765305068416:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869535.182548:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869535.182584:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6ceed2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e67 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.182624:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:3.0:1788869535.182631:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869535.182666:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.182688:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.182700:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869535.182846:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061b179c1 reply state 00000000a69cc22e transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.182871:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.182878:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:3.0:1788869535.182881:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869535.182884:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869535.183014:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11324:x1875765305068416:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 531us (1678us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1788869535.183021:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1788869535.191997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869535.192110:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305068544 00000100:00100000:3.0:1788869535.192120:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305068544 00000100:00100000:3.0:1788869535.192174:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1788869535.192185:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305068544:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869535.192330:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788869535.192333:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788869534 -> 1788869533 00002000:00010000:3.0:1788869535.192336:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788869531 00002000:00010000:3.0:1788869535.192338:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788869534 -> 1788869533 00002000:00010000:3.0:1788869535.192340:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788869535.192415:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305068544:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 232us (433us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788869535.192442:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788869535.199657:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869535.199775:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305068800 00000100:00100000:2.0:1788869535.199786:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305068800 00000100:00100000:2.0:1788869535.199846:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:2.0:1788869535.199873:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:11324:x1875765305068800:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788869535.199968:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.199988:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e59 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.199997:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.200035:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e59 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.200049:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e59 expref: 15 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869535.200065:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325085440:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869535.200165:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8540 going to sleep for 11 seconds 00000100:00100000:2.0:1788869535.209219:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.209295:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305068928 00000100:00100000:1.0:1788869535.209305:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305068928 00010000:00010000:1.0:1788869535.209351:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e59 expref: 16 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.209393:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:1.0:1788869535.209403:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:2410:x1875765305068928:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869535.209429:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869535.209441:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e59 expref: 16 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.209454:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e59 expref: 16 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.209479:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:1.0:1788869535.209484:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.209493:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.209500:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.209517:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869535.209569:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:2410:x1875765305068928:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 168us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.209577:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00010000:00010000:0.0:1788869535.211019:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6ceeaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e59 expref: 15 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.211043:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325085440:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869535.211072:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.211084:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.211090:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.211146:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.211155:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.211162:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.211168:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869535.211173:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.211182:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.211218:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:0.0:1788869535.211221:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788869535.211226:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.211232:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6ceeee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.211347:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11324:x1875765305068800:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 11491us (11701us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788869535.211356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:2.0:1788869535.221798:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.221892:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305069056 00000100:00100000:1.0:1788869535.221914:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305069056 00000100:00100000:1.0:1788869535.221991:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1788869535.222001:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2408:x1875765305069056:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788869535.222054:0:11338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.222076:0:11338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 7 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.222086:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869535.222090:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869535.222095:0:11338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.222134:0:11338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 7 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.222149:0:11338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 7 pid: 8743 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.222164:0:11338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11338:1875765325085568:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869535.222241:0:11338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869535.232624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.232749:0:11338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11338:1875765325085568:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869535.232780:0:11338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.232882:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305069184 00000100:00100000:0.0:1788869535.232890:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305069184 00010000:00010000:0.0:1788869535.232933:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 8 pid: 8743 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.232984:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1788869535.232993:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305069184:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869535.233008:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869535.233031:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 8 pid: 8743 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.233044:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 8 pid: 8743 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.233072:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c396087/0x4c16c38a9b6ceee0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e75 expref: 8 pid: 8743 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.233100:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869535.233105:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869535.233111:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.233122:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.233157:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869535.233217:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305069184:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 224us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869535.233225:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00010000:00010000:1.0:1788869535.233437:0:11338:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.233446:0:11338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.233470:0:11338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.233479:0:11338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.233487:0:11338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.233495:0:11338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869535.233500:0:11338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.233511:0:11338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.233526:0:11338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.233545:0:11338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068cb34ce/0x4c16c38a9b6ceef5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.233643:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305069056:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 11644us (11857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.233650:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:0.0:1788869535.238268:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.238336:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305069440 00000100:00100000:1.0:1788869535.238345:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305069440 00000100:00100000:1.0:1788869535.238414:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:1.0:1788869535.238424:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11324:x1875765305069440:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788869535.238516:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.238535:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dfe expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.238545:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.238620:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dfe expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.238633:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dfe expref: 14 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.238647:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325085696:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869535.238738:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869535.243352:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325085696:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869535.243393:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.246343:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.246840:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305069568 00000100:00100000:1.0:1788869535.246859:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305069568 00010000:00010000:1.0:1788869535.246904:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dfe expref: 15 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.246951:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1788869535.246962:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:2409:x1875765305069568:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869535.246977:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869535.246985:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dfe expref: 15 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.246998:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dfe expref: 15 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.247022:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6ced3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9dfe expref: 15 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.247040:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869535.247046:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.247057:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.247065:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.247096:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869535.247170:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:2409:x1875765305069568:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 209us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.247177:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00010000:00010000:3.0:1788869535.247353:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.247362:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.247575:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.247620:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e60 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.247629:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.247663:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e60 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.247678:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e60 expref: 14 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869535.247693:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325085824:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869535.247751:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a37bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869535.252255:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.252333:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305069696 00000100:00100000:1.0:1788869535.252343:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305069696 00010000:00010000:1.0:1788869535.252380:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e60 expref: 15 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.252427:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:1.0:1788869535.252441:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:2410:x1875765305069696:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869535.252456:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869535.252463:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e60 expref: 15 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.252476:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e60 expref: 15 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.252500:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:1.0:1788869535.252505:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.252515:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.252523:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.252542:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869535.252637:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:2410:x1875765305069696:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 198us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.252662:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00010000:00010000:3.0:1788869535.253125:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6ceebd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e60 expref: 14 pid: 6524 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869535.253144:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325085824:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869535.253169:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.253178:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.253184:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869535.253309:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788869535.253537:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:3.0:1788869535.253575:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788869535.257209:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703912a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325085952:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788869535.257300:0:8260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869535.257426:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869535.258387:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325085952 00000100:00100000:1.0:1788869535.258401:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325085952 00000100:00100000:1.0:1788869535.258765:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788869535.258778:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8260:x1875765325085952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788869535.258922:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8260:x1875765325085952:12345-0@lo:1000:mdt00_003.0 Request processed in 147us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.258930:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788869535.259025:0:8260:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788869535.259033:0:8260:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e270402d500, transno 4294967304 00000100:00100000:3.0:1788869535.259055:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703912a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325085952:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788869535.259243:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:3.0:1788869535.259314:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325086080:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788869535.259355:0:8260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869535.260069:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869535.260158:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325086080 00000100:00100000:2.0:1788869535.260166:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325086080 00000100:00100000:2.0:1788869535.260205:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788869535.260213:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8260:x1875765325086080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788869535.260357:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8260:x1875765325086080:12345-0@lo:1000:mdt00_003.0 Request processed in 144us (1001us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788869535.260365:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788869535.260624:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325086080:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788869535.260672:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260684:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260713:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260719:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869535.260724:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260732:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260749:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:3.0:1788869535.260752:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869535.260759:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260765:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef03 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260802:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260809:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260814:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260819:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869535.260822:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260839:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260848:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869535.260861:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869535.260865:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260870:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cee38 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260896:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260911:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e44 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260920:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260964:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e44 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.260980:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e44 expref: 17 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869535.260993:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325086208:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869535.261083:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869535.264512:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869535.264836:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325086208:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869535.264893:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.265262:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305069824 00000100:00100000:1.0:1788869535.265272:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305069824 00010000:00010000:1.0:1788869535.265312:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e44 expref: 18 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.265350:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1788869535.265360:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:2410:x1875765305069824:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869535.265375:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869535.265384:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e44 expref: 18 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.265396:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e44 expref: 18 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.265427:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cee54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e44 expref: 18 pid: 6526 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.265984:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:1.0:1788869535.266004:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.266015:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.266023:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.266089:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869535.266180:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:2410:x1875765305069824:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 814us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.266188:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00010000:00010000:3.0:1788869535.268243:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268261:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268278:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268284:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268291:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268298:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9c00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869535.268302:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268310:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268327:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869535.268330:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869535.268334:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268340:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef0a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268377:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268382:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268387:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268392:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869535.268396:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268401:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268538:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2803eb6600) 00010000:00010000:3.0:1788869535.268541:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869535.268545:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.268551:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6ceefc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.269509:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:11324:x1875765305069440:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 31073us (31237us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788869535.269522:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000020:00080000:1.0:1788869535.269529:0:8260:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788869535.272842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869535.272925:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305070080 00000100:00100000:3.0:1788869535.272946:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305070080 00000100:00100000:3.0:1788869535.273049:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788869535.273060:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:11324:x1875765305070080:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788869535.273352:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788869535.273391:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:3.0:1788869535.273677:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.273696:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.273708:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.273717:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.273724:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.273731:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.273755:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869535.273859:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:11324:x1875765305070080:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 790us (1020us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788869535.273867:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000020:00080000:3.0:1788869535.273872:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788869535.274044:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869535.274049:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869535.274080:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788869535.274088:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788869535.274246:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869535.274255:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.274262:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869535.274266:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.274274:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.274289:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:1.0:1788869535.274292:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788869535.274297:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.274311:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cef11 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.274324:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869535.274326:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869535.274327:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869535.512076:0:14217:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869535.512179:0:14217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869535.512218:0:14217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788869535.512227:0:14217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869535.693078:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869535.693557:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305070336 00000100:00100000:3.0:1788869535.693566:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305070336 00000100:00100000:3.0:1788869535.693707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:3.0:1788869535.693718:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:11334:x1875765305070336:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869535.693747:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869535.693770:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e7c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.693916:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6cef1f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.693931:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6cef1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.693943:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6cef1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869535.694487:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788869535.694737:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cef18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e7c expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.694755:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6cef1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e7c expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869535.694764:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:3.0:1788869535.694767:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869535.694770:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9e00, rc 0) 00000100:00100000:3.0:1788869535.694835:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11334:x1875765305070336:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1119us (1766us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788869535.694854:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:3.0:1788869535.700887:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869535.701178:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305070464 00000100:00100000:0.0:1788869535.701191:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305070464 00000100:00100000:0.0:1788869535.701255:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1788869535.701267:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11334:x1875765305070464:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1788869535.701350:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702062:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702080:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702116:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702126:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702133:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702217:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702226:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702233:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869535.702284:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702297:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702303:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702311:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702632:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869535.702637:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702651:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702664:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:0.0:1788869535.702667:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869535.702672:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702678:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cef2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702690:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702696:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702702:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702708:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869535.702711:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702719:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702727:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2809bdcd00) 00010000:00010000:0.0:1788869535.702730:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869535.702733:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702750:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cef34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702769:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702776:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702782:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702786:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869535.702789:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702795:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702802:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869535.702804:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869535.702807:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.702813:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cef3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.703327:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11334:x1875765305070464:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 2056us (2444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.703347:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:1.0:1788869535.762684:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.762729:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305070720 00000100:00100000:1.0:1788869535.762740:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305070720 00000100:00100000:1.0:1788869535.762800:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1788869535.762811:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11337:x1875765305070720:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869535.762833:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869535.762872:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cef42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e83 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.762948:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.762965:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.762990:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763007:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763014:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763021:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763147:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763156:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763164:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869535.763175:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788869535.763686:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763695:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763703:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763709:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869535.763720:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763729:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763741:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869535.763744:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869535.763750:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763756:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763767:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763773:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763778:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763783:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869535.763786:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763792:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763799:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ece100) 00010000:00010000:1.0:1788869535.763801:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869535.763811:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763817:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763895:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cef42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e83 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763910:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e83 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.763917:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:1.0:1788869535.763920:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869535.763922:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f000, rc 0) 00000100:00100000:1.0:1788869535.763989:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:11337:x1875765305070720:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1179us (1316us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788869535.763997:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1788869535.775556:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869535.775641:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305070848 00000100:00100000:2.0:1788869535.775652:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305070848 00000100:00100000:2.0:1788869535.775718:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:2.0:1788869535.775729:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:11337:x1875765305070848:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788869535.775799:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.775817:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.775829:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.775878:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.775886:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.775904:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.775910:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869535.775914:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.775922:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.775933:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:2.0:1788869535.775936:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869535.775941:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.775948:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cef65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869535.776017:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:11337:x1875765305070848:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 290us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869535.776025:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1788869535.784069:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869535.784200:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305071104 00000100:00100000:2.0:1788869535.784210:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305071104 00000100:00100000:2.0:1788869535.784276:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788869535.784287:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28268b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:11337:x1875765305071104:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869535.784549:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28268b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:11337:x1875765305071104:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 263us (491us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788869535.784556:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788869535.821576:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.821764:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305071360 00000100:00100000:1.0:1788869535.821774:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305071360 00000100:00100000:1.0:1788869535.821851:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1788869535.821863:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:10863:x1875765305071360:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869535.821888:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869535.821912:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef6c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e8a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.822057:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.822086:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e83 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.822094:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.822128:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e83 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.822142:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e83 expref: 24 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869535.822156:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325086336:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869535.822265:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869535.825391:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869535.825522:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325086336:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869535.825552:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.827460:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305071488 00000100:00100000:0.0:1788869535.827475:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305071488 00010000:00010000:0.0:1788869535.827527:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e83 expref: 25 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.827605:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:0.0:1788869535.827615:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:2410:x1875765305071488:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869535.827633:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869535.827640:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e83 expref: 25 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.827652:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e83 expref: 25 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.827672:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cef57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e83 expref: 25 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.827688:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:0.0:1788869535.827693:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.827701:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.827709:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.827737:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869535.827818:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:2410:x1875765305071488:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 203us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869535.827825:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00010000:00010000:1.0:1788869535.828480:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.828490:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869535.828510:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788869535.828684:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef6c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e8a expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.828704:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e8a expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.828726:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:1.0:1788869535.828729:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869535.828732:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f200, rc 0) 00000100:00100000:1.0:1788869535.828784:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:10863:x1875765305071360:12345-192.168.204.54@tcp:101:bash.0 Request processed in 6924us (7219us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788869535.828792:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1788869535.837917:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869535.841372:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305071616 00000100:00100000:2.0:1788869535.841389:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305071616 00000100:00100000:1.0:1788869535.844166:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:1.0:1788869535.844185:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:10863:x1875765305071616:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869535.844221:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869535.844248:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e91 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.844285:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cef88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.844302:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cef88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.844314:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cef88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.844455:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e91 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.844476:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cef88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e91 expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.844497:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:1.0:1788869535.844500:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869535.844503:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e400, rc 0) 00000100:00100000:1.0:1788869535.844780:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:10863:x1875765305071616:12345-192.168.204.54@tcp:101:bash.0 Request processed in 601us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.844787:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:2.0:1788869535.852214:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.852357:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305071872 00000100:00100000:1.0:1788869535.852368:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305071872 00000100:00100000:1.0:1788869535.852444:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:1.0:1788869535.852454:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:10863:x1875765305071872:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:1.0:1788869535.852767:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.852786:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.852798:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869535.852859:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:1.0:1788869535.852883:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e288350b reply state 00000000130a9651 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.852895:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.852903:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:1.0:1788869535.852905:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869535.852923:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788869535.852978:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:1.0:1788869535.853110:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+29:10863:x1875765305071872:12345-192.168.204.54@tcp:36:bash.0 Request processed in 656us (914us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788869535.853117:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000020:00080000:1.0:1788869535.853122:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788869535.857085:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869535.857207:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305072000 00000100:00100000:2.0:1788869535.857220:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305072000 00000100:00100000:2.0:1788869535.857296:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:2.0:1788869535.857307:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+29:10863:x1875765305072000:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869535.857336:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869535.857360:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cef96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e98 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.857439:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cef96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e98 expref: 30 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.857454:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cef96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e98 expref: 30 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869535.857474:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:2.0:1788869535.857477:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869535.857481:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb200, rc 0) 00000100:00100000:2.0:1788869535.857554:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:10863:x1875765305072000:12345-192.168.204.54@tcp:101:bash.0 Request processed in 247us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869535.857561:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1788869535.864890:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.865096:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305072128 00000100:00100000:1.0:1788869535.865108:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305072128 00000100:00100000:1.0:1788869535.865170:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1788869535.865181:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:10863:x1875765305072128:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869535.865199:0:8743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869535.865221:0:8743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9e9f expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869535.865249:0:8743:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ffb9d, atime: 0x6a9ffb9b, ctime: 0x6a9ffb9d, blocks: 0x8 00010000:00010000:1.0:1788869535.865277:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1788869535.865282:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869535.865290:0:8743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e9f expref: 7 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.865306:0:8743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e9f expref: 7 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.865320:0:8743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ea00, rc 0) 00000100:00100000:1.0:1788869535.866748:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:10863:x1875765305072128:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1560us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.866760:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1788869535.873903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869535.876200:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305072256 00000100:00100000:2.0:1788869535.876217:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305072256 00002000:00010000:2.0:1788869535.876266:0:8446:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788869535.876271:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e283b470700 with x1875765305072256 ext(0->18446744073709551615) 00002000:00010000:2.0:1788869535.876285:0:8446:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e283b470700. 00000100:00100000:2.0:1788869535.876333:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788869535.876344:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305072256:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:2.0:1788869535.877091:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788869535.877097:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788869533 -> 1788869534 00002000:00010000:2.0:1788869535.877100:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788869531 -> 1788869531 00002000:00010000:2.0:1788869535.877102:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788869533 -> 1788869534 00002000:00010000:2.0:1788869535.877104:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788869535.877168:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305072256:12345-192.168.204.54@tcp:10:bash.0 Request processed in 826us (3275us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788869535.877175:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00010000:2.0:1788869535.877179:0:8446:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788869535.877182:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e283b470700 with x1875765305072256 ext(0->18446744073709551615) 00002000:00010000:2.0:1788869535.877187:0:8446:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e283b470700. 00010000:00010000:1.0:1788869535.945152:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869535.982207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869535.983114:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305072384 00000100:00100000:1.0:1788869535.983126:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305072384 00000100:00100000:1.0:1788869535.983195:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1788869535.983206:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:11351:x1875765305072384:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1788869535.983281:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.983299:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.983313:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.983525:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.983535:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869535.983543:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984786:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984820:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984831:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869535.984898:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984910:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984916:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984922:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984928:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869535.984932:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984940:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984952:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:0.0:1788869535.984955:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869535.984961:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984968:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cefa4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.984991:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985835:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985854:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985861:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869535.985864:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985873:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985884:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701ece600) 00010000:00010000:0.0:1788869535.985887:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869535.985891:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985897:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cefab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985933:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985940:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985946:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985960:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869535.985963:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985969:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985978:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:0.0:1788869535.985980:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869535.985982:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869535.985988:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cefb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869535.986106:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:11351:x1875765305072384:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 2898us (3906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869535.986115:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1788869536.051902:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.052027:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305072640 00000100:00100000:2.0:1788869536.052039:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305072640 00000100:00100000:2.0:1788869536.052107:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:2.0:1788869536.052118:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:11354:x1875765305072640:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869536.052155:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869536.052183:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ea6 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052290:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052305:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052318:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052335:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052342:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052348:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052474:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cefce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052484:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cefce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052491:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cefce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869536.052501:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788869536.052583:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052635:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052649:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052655:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869536.052659:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052666:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052678:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869536.052681:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869536.052685:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052691:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052705:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052710:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052716:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052720:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869536.052723:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052738:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052746:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e280839cc00) 00010000:00010000:2.0:1788869536.052748:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869536.052751:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052757:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cefc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052802:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ea6 expref: 33 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052814:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cefce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ea6 expref: 32 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.052822:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:2.0:1788869536.052824:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788869536.052827:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda000, rc 0) 00000100:00100000:2.0:1788869536.053152:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+32:11354:x1875765305072640:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1033us (1259us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788869536.053160:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:3.0:1788869536.064891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.067608:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305072768 00000100:00100000:2.0:1788869536.067625:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305072768 00000100:00100000:2.0:1788869536.067753:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:2.0:1788869536.067764:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+32:11354:x1875765305072768:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788869536.067862:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.067882:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e8a expref: 32 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.067890:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.067928:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e8a expref: 32 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.067944:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e8a expref: 32 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.067959:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325086464:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869536.068122:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869536.076953:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869536.077012:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325086720:0@lo:400:kworker.0 00000100:00100000:2.0:1788869536.077076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869536.077135:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869536.077275:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325086848:0@lo:400:kworker.0 00000100:00100000:2.0:1788869536.077306:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869536.077337:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325086848 00000100:00100000:2.0:1788869536.077344:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325086848 00000100:00100000:2.0:1788869536.077389:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788869536.077397:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325086848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869536.077467:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325086848:12345-0@lo:400:kworker.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.077490:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788869536.077534:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325086848:0@lo:400:kworker.0 00000100:00100000:2.0:1788869536.077575:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325086720 00000100:00100000:2.0:1788869536.077579:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325086720 00000100:00100000:2.0:1788869536.077623:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788869536.077629:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325086720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869536.077664:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325086720:12345-0@lo:400:kworker.0 Request processed in 34us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.077669:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788869536.077695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325086720:0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.081867:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325086976:0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.081952:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869536.081992:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325086592:0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.082022:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869536.082068:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325086976 00000100:00100000:0.0:1788869536.082077:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325086976 00000100:00100000:0.0:1788869536.082125:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788869536.082134:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325086976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.083056:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325086976:12345-0@lo:400:kworker.0 Request processed in 918us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.083080:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788869536.083570:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325086592 00000100:00100000:2.0:1788869536.083580:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325086592 00000100:00100000:2.0:1788869536.083649:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788869536.083657:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325086592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869536.083700:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325086592:12345-0@lo:400:kworker.0 Request processed in 44us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.083707:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788869536.083846:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325086976:0@lo:400:kworker.0 00000100:00100000:1.0:1788869536.083861:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325086592:0@lo:400:kworker.0 00000100:00100000:3.0:1788869536.084663:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325086464:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869536.084684:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869536.084933:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325087488:0@lo:400:kworker.0 00000100:00100000:1.0:1788869536.084976:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869536.085010:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325088000:0@lo:400:kworker.0 00000100:00100000:1.0:1788869536.085045:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869536.085068:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788869536.085073:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325087104:0@lo:400:kworker.0 00000100:00100000:1.0:1788869536.085096:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869536.085111:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325087616:0@lo:400:kworker.0 00000100:00100000:1.0:1788869536.085134:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869536.085290:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325087488 00000100:00100000:1.0:1788869536.085296:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325087488 00000100:00100000:1.0:1788869536.085337:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325088000 00000100:00100000:1.0:1788869536.085341:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325088000 00000100:00100000:1.0:1788869536.085361:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788869536.085368:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325087488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869536.085411:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325087488:12345-0@lo:400:kworker.0 Request processed in 43us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.085516:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325087104 00000100:00100000:0.0:1788869536.085521:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325087104 00000100:00100000:0.0:1788869536.085550:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788869536.085556:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325087104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.085620:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325087104:12345-0@lo:400:kworker.0 Request processed in 64us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.085626:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788869536.085705:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325087360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869536.085734:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869536.085763:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325087872:0@lo:400:kworker.0 00000100:00100000:3.0:1788869536.085784:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869536.085804:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788869536.085809:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325087232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869536.085830:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869536.085857:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325087744:0@lo:400:kworker.0 00000100:00100000:3.0:1788869536.085877:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869536.085895:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325087872 00000100:00100000:3.0:1788869536.085898:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325087872 00000100:00100000:3.0:1788869536.085920:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788869536.085927:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1875765325088000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869536.085958:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1875765325088000:12345-0@lo:400:kworker.0 Request processed in 32us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869536.085965:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788869536.085991:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869536.085997:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325087872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869536.086028:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325087872:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869536.086034:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869536.086077:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325087872:0@lo:400:kworker.0 00000100:00080000:3.0:1788869536.086116:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869536.086121:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869536.086131:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325087616 00000100:00100000:3.0:1788869536.086134:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325087616 00000100:00100000:1.0:1788869536.086229:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788869536.086263:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325087104:0@lo:400:kworker.0 00000100:00100000:1.0:1788869536.086274:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325087488:0@lo:400:kworker.0 00000100:00100000:1.0:1788869536.086283:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325088000:0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.086398:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325087360 00000100:00100000:0.0:1788869536.086403:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325087360 00000100:00100000:0.0:1788869536.086501:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325087232 00000100:00100000:0.0:1788869536.086505:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325087232 00000100:00100000:0.0:1788869536.086518:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325087744 00000100:00100000:0.0:1788869536.086520:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325087744 00000100:00100000:0.0:1788869536.086533:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788869536.086539:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325087360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.086602:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325087360:12345-0@lo:400:kworker.0 Request processed in 45us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.086609:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788869536.086622:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788869536.086628:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325087232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.086657:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325087232:12345-0@lo:400:kworker.0 Request processed in 29us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.086663:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788869536.086674:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788869536.086680:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325087744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.086718:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325087744:12345-0@lo:400:kworker.0 Request processed in 39us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.086724:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788869536.086799:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325087232:0@lo:400:kworker.0 00010000:00080000:2.0:1788869536.086812:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0bd880 x1875765325087744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869536.086821:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325087744:0@lo:400:kworker.0 00010000:00080000:2.0:1788869536.086829:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703baa680 x1875765325087360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869536.086848:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325087360:0@lo:400:kworker.0 00000100:00080000:1.0:1788869536.090344:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869536.090354:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869536.090565:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788869536.090580:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325087616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869536.090715:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325087616:12345-0@lo:400:kworker.0 Request processed in 140us (5579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.090724:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788869536.090908:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325087616:0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.091079:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.091260:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305073024 00000100:00100000:1.0:1788869536.091267:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305073024 00000100:00100000:1.0:1788869536.091295:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1788869536.091302:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:6179:x1875765305073024:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788869536.091629:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+34:6179:x1875765305073024:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 325us (551us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788869536.091650:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1788869536.094351:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.094437:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305073152 00000100:00100000:1.0:1788869536.094448:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305073152 00010000:00010000:1.0:1788869536.094489:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e8a expref: 34 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869536.094530:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1788869536.094541:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+34:2409:x1875765305073152:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869536.094558:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869536.094567:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e8a expref: 34 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.094581:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e8a expref: 34 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.094648:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cef73 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e8a expref: 34 pid: 6525 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.094667:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:1.0:1788869536.094672:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.094683:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.094690:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.094739:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869536.094788:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:2409:x1875765305073152:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 249us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.094796:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00010000:00010000:3.0:1788869536.094951:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.094960:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.095002:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.095009:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.095016:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.095022:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869536.095026:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.095034:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.095043:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:3.0:1788869536.095047:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869536.095059:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.095065:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cefdc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869536.095110:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+32:11354:x1875765305072768:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 27348us (30229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869536.095117:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:3.0:1788869536.098312:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.098392:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305073408 00000100:00100000:1.0:1788869536.098402:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305073408 00000100:00100000:1.0:1788869536.098471:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1788869536.098483:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+32:11354:x1875765305073408:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869536.098768:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:11354:x1875765305073408:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 286us (465us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788869536.098776:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788869536.246459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.246618:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305073664 00000100:00100000:2.0:1788869536.246629:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305073664 00000100:00100000:2.0:1788869536.246697:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:2.0:1788869536.246708:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:11365:x1875765305073664:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788869536.246735:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869536.246757:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefe3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ead expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.246844:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.246860:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.246872:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.246888:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.246894:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.246900:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247044:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ceff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247054:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ceff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247061:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ceff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869536.247070:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788869536.247315:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247322:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247329:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247334:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869536.247337:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247344:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247356:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869536.247359:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869536.247364:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247381:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cefea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247397:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247403:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247408:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247653:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869536.247657:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247664:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247672:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e280839cc00) 00010000:00010000:2.0:1788869536.247674:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869536.247677:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247683:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6ceff1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247728:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cefe3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ead expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247744:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ceff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ead expref: 35 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.247758:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:2.0:1788869536.247761:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869536.247763:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda400, rc 0) 00000100:00100000:2.0:1788869536.247846:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+35:11365:x1875765305073664:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1128us (1387us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788869536.247853:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1788869536.256062:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.257091:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305073920 00000100:00100000:1.0:1788869536.257107:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305073920 00000100:00100000:1.0:1788869536.257324:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:1.0:1788869536.257335:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+35:11365:x1875765305073920:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:1.0:1788869536.258003:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:11365:x1875765305073920:12345-192.168.204.54@tcp:35:cat.0 Request processed in 668us (1949us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788869536.258013:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1788869536.291647:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.291757:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305074176 00000100:00100000:1.0:1788869536.291770:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305074176 00000100:00100000:1.0:1788869536.291854:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:1.0:1788869536.291865:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:11366:x1875765305074176:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:1.0:1788869536.291931:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788869536.291963:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cef96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e98 expref: 36 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292010:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6ceff8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ead expref: 35 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292021:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cefce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ea6 expref: 34 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292032:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cef88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e91 expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292043:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:1.0:1788869536.292048:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869536.292071:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292084:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292094:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292122:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292131:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292137:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292222:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292230:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292236:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869536.292461:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788869536.292471:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470205883780ns, next at 471205881159ns, rc = 0 00010000:00010000:1.0:1788869536.292522:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292531:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292539:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292547:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292555:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292562:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292647:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869536.292668:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292682:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292688:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292693:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869536.292698:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292706:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292715:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:1.0:1788869536.292718:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788869536.292722:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292728:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf014 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292747:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292753:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292758:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292763:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869536.292771:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292778:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292787:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869536.292789:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869536.292792:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292798:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf006 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869536.292807:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000104752da reply state 000000008773ea1c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292818:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.292824:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701eceb00) 00010000:00010000:1.0:1788869536.292826:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869536.292829:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869536.292917:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+34:11366:x1875765305074176:12345-192.168.204.54@tcp:36:rm.0 Request processed in 1052us (1279us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788869536.292925:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00010000:00010000:2.0:1788869536.293189:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869536.293197:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.293203:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869536.293207:0:7475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.293213:0:7475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.293223:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:2.0:1788869536.293226:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788869536.293229:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.293234:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf01b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.293246:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869536.293247:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869536.293249:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869536.344159:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.344271:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305074432 00000100:00100000:2.0:1788869536.344297:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305074432 00000100:00100000:2.0:1788869536.344359:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:2.0:1788869536.344369:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+34:11372:x1875765305074432:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869536.344397:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869536.344434:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf022 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9eb4 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.344550:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.344564:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.344576:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.344628:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.344636:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.344643:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869536.344950:0:8260:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788869536.345064:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345073:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345091:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345122:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345129:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345135:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345141:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869536.345146:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345153:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345163:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869536.345166:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869536.345171:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345176:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf029 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869536.345189:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b057a50 reply state 000000006d40f1e0 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345200:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345212:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701eceb00) 00010000:00010000:2.0:1788869536.345215:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869536.345218:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788869536.345243:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf022 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eb4 expref: 37 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345256:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eb4 expref: 36 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.345263:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839cc00) 00010000:00010000:2.0:1788869536.345265:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869536.345267:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edbc00, rc 0) 00000100:00100000:2.0:1788869536.345332:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+37:11372:x1875765305074432:12345-192.168.204.54@tcp:101:bash.0 Request processed in 965us (1184us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788869536.345340:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:3.0:1788869536.354846:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.354961:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305074560 00000100:00100000:1.0:1788869536.354972:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305074560 00000100:00100000:1.0:1788869536.355033:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1788869536.355044:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305074560:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869536.355062:0:8743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869536.355117:0:8743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ebb expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869536.355146:0:8743:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869536.355171:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1788869536.355175:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869536.355185:0:8743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ebb expref: 8 pid: 8743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.355205:0:8743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ebb expref: 8 pid: 8743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.355219:0:8743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f200, rc 0) 00000100:00100000:1.0:1788869536.355283:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305074560:12345-192.168.204.54@tcp:101:bash.0 Request processed in 241us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.355291:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788869536.360123:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.360248:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305074688 00000100:00100000:1.0:1788869536.360258:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305074688 00000100:00100000:1.0:1788869536.360324:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1788869536.360335:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:11372:x1875765305074688:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869536.360353:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869536.360374:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ec2 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.360409:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ebb expref: 9 pid: 8743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.360450:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869536.360454:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869536.360461:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.360500:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ebb expref: 9 pid: 8743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.360517:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ebb expref: 9 pid: 8743 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869536.360533:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1875765325088128:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869536.360721:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0cacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869536.363315:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1875765325088128:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869536.363352:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.363371:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f000, rc 0) 00000100:00100000:1.0:1788869536.364744:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:11372:x1875765305074688:12345-192.168.204.54@tcp:101:bash.0 Request processed in 4401us (4623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.364756:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1788869536.367387:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869536.367582:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305074816 00000100:00100000:0.0:1788869536.367609:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305074816 00010000:00010000:0.0:1788869536.367654:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ebb expref: 9 pid: 8743 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869536.367748:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:0.0:1788869536.367758:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2409:x1875765305074816:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869536.367776:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869536.367807:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ebb expref: 9 pid: 8743 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.367822:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ebb expref: 9 pid: 8743 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.367859:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068cb34ce/0x4c16c38a9b6cf045 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ebb expref: 9 pid: 8743 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.367878:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869536.367882:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869536.367891:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.368048:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.368098:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869536.368128:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f478e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1875765325088256:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788869536.368221:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869536.372191:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.373294:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f478e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1875765325088256:192.168.204.54@tcp:105: 00010000:00010000:2.0:1788869536.373323:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869536.373388:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2409:x1875765305074816:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 5631us (6016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.373400:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:3.0:1788869536.373502:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305075072 00000100:00100000:3.0:1788869536.373510:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305075072 00000100:00100000:3.0:1788869536.373564:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788869536.373573:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+37:11372:x1875765305075072:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1788869536.373910:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+38:11372:x1875765305075072:12345-192.168.204.54@tcp:35:bash.0 Request processed in 337us (1729us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788869536.373928:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1788869536.544808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.544941:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305075200 00000100:00100000:1.0:1788869536.544950:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305075200 00000100:00100000:1.0:1788869536.545019:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:1.0:1788869536.545049:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+38:11388:x1875765305075200:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869536.545085:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869536.545120:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf053 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ec9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.545208:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf05a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.545224:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf05a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.545236:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf05a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869536.545285:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788869536.545290:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869536.545311:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf05a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.545339:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf053 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec9 expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.545361:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf05a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec9 expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.545370:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869536.545373:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869536.545377:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f200, rc 0) 00000100:00100000:1.0:1788869536.545457:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:11388:x1875765305075200:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 411us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.545473:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:0.0:1788869536.551809:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.551923:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305075456 00000100:00100000:2.0:1788869536.551935:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305075456 00000100:00100000:2.0:1788869536.552001:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:2.0:1788869536.552012:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:11388:x1875765305075456:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869536.552049:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869536.552098:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf061 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ed0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.552229:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf068 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.552245:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.552259:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869536.552272:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788869536.552386:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf061 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ed0 expref: 42 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.552425:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf068 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ed0 expref: 41 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.552434:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839cc00) 00010000:00010000:2.0:1788869536.552437:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869536.552442:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb800, rc 0) 00000100:00100000:2.0:1788869536.552514:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+41:11388:x1875765305075456:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 504us (718us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788869536.552521:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:0.0:1788869536.557727:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869536.557767:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.557870:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305075712 00000100:00100000:1.0:1788869536.557880:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305075712 00000100:00100000:1.0:1788869536.557955:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:1.0:1788869536.557967:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+41:11388:x1875765305075712:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869536.557996:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869536.558019:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf076 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ed7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.558161:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf07d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.558180:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf07d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.558193:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf07d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869536.558207:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788869536.558310:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf076 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ed7 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.558330:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf07d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ed7 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.558338:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839cc00) 00010000:00010000:1.0:1788869536.558341:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788869536.558344:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f400, rc 0) 00000100:00100000:1.0:1788869536.558487:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:11388:x1875765305075712:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 522us (777us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1788869536.558495:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:2.0:1788869536.559423:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305075840 00000100:00100000:2.0:1788869536.559433:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305075840 00000100:00100000:2.0:1788869536.559485:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788869536.559494:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:2409:x1875765305075840:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869536.559528:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869536.559554:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf068 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ed0 expref: 43 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.559570:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839cc00) 00010000:00010000:2.0:1788869536.559575:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869536.559656:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+42:2409:x1875765305075840:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 162us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.559663:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788869536.568549:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.568701:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305075968 00000100:00100000:2.0:1788869536.568713:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305075968 00000100:00100000:2.0:1788869536.568783:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788869536.568794:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2408:x1875765305075968:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:2.0:1788869536.568860:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.568883:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.568891:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869536.568896:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869536.568901:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.568955:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.568991:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 8 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.569006:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1875765325088384:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869536.569106:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869536.572823:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.572964:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1875765325088384:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869536.572993:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869536.573081:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305076096 00000100:00100000:0.0:1788869536.573089:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305076096 00002000:00100000:0.0:1788869536.573141:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8e283f47dc00 x1875765305076096/t0(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:482/0 lens 504/0 e 0 to 0 dl 1788869547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788869536.573152:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e283f47dc00 with x1875765305076096 ext(0->8) 00010000:00010000:0.0:1788869536.573160:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 9 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.573174:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 9 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869536.573183:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e283f47dc00 00000100:00100000:0.0:1788869536.573238:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1788869536.573249:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2410:x1875765305076096:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:0.0:1788869536.574727:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:2410:x1875765305076096:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 1469us (1908us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788869536.574741:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00100000:0.0:1788869536.574752:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8e283f47dc00 x1875765305076096/t4294967303(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:482/0 lens 504/448 e 0 to 0 dl 1788869547 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788869536.574762:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e283f47dc00 with x1875765305076096 ext(0->8) 00010000:00010000:0.0:1788869536.574772:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 11 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.574790:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 11 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869536.574798:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e283f47dc00 00000100:00100000:0.0:1788869536.577851:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.578011:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305076224 00000100:00100000:1.0:1788869536.578023:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305076224 00010000:00010000:1.0:1788869536.578070:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 11 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869536.578227:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788869536.578239:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:2409:x1875765305076224:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869536.578256:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788869536.578278:0:6510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788869536.578282:0:6510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788869535 00002000:00010000:1.0:1788869536.578284:0:6510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788869535 00002000:00010000:1.0:1788869536.578287:0:6510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788869535 00002000:00010000:1.0:1788869536.578289:0:6510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788869536.578295:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 11 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.578311:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 11 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.578337:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cf04c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec2 expref: 11 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.578356:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869536.578360:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869536.578382:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.578392:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.578441:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869536.578502:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:2409:x1875765305076224:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 266us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.578510:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00010000:00010000:0.0:1788869536.579183:0:8443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.579197:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.579220:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.579228:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.579246:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.579254:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869536.579258:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.579268:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.579283:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.579291:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035ac0914/0x4c16c38a9b6cf08b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869536.579365:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2408:x1875765305075968:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 10572us (10832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.579374:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1788869536.582091:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869536.582153:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305076480 00000100:00100000:3.0:1788869536.582164:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305076480 00000100:00100000:3.0:1788869536.582229:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1788869536.582240:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28268b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+42:11388:x1875765305076480:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:3.0:1788869536.582310:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf07d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ed7 expref: 42 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869536.582531:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788869536.582565:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:3.0:1788869536.582988:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:3.0:1788869536.583030:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.583047:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eb4 expref: 46 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.583057:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.583101:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eb4 expref: 46 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.583119:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eb4 expref: 46 pid: 8260 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869536.583139:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875765325088512:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869536.583242:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703952540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869536.583306:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869536.583319:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325088640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869536.583367:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869536.584565:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325088640 00000100:00100000:0.0:1788869536.584577:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325088640 00000100:00100000:0.0:1788869536.584658:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788869536.584669:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325088640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869536.584695:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869536.584787:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325088640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.584794:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788869536.584866:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325088640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869536.588859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869536.589058:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305076608 00000100:00100000:0.0:1788869536.589068:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305076608 00010000:00010000:0.0:1788869536.589133:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eb4 expref: 47 pid: 8260 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869536.589170:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1788869536.589181:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+47:2409:x1875765305076608:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869536.589198:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869536.589206:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eb4 expref: 47 pid: 8260 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.589219:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eb4 expref: 47 pid: 8260 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.589240:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839cc00) 00010000:00010000:0.0:1788869536.589245:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.589255:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.589263:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.589282:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869536.589352:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+47:2409:x1875765305076608:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 173us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.589359:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1788869536.591402:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869536.591433:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325088768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869536.591504:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869536.591677:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325088768 00000100:00100000:0.0:1788869536.591687:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325088768 00000100:00100000:0.0:1788869536.591738:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788869536.591747:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325088768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869536.591771:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869536.591817:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325088768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.591834:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788869536.591928:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325088768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788869536.592251:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf037 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eb4 expref: 46 pid: 8260 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.592271:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875765325088512:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869536.592292:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.592300:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.592306:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869536.592492:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:2.0:1788869536.592785:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788869536.592884:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875765325088896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788869536.593021:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869536.593092:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869536.593240:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325088896 00000100:00100000:1.0:1788869536.593248:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325088896 00000100:00100000:1.0:1788869536.593342:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788869536.593351:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6527:x1875765325088896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788869536.593455:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6527:x1875765325088896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.593463:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788869536.593540:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875765325088896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788869536.593692:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:2.0:1788869536.593739:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875765325089024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788869536.593766:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869536.594044:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869536.594135:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325089024 00000100:00100000:0.0:1788869536.594141:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325089024 00000100:00100000:0.0:1788869536.594168:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788869536.594176:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6527:x1875765325089024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788869536.594292:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6527:x1875765325089024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 117us (524us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788869536.594299:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788869536.594368:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875765325089024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788869536.594405:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788869536.594504:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.594514:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.594523:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.594529:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869536.594533:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.594541:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.594557:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839cc00) 00010000:00010000:2.0:1788869536.594561:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788869536.594566:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.594625:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf092 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869536.594741:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788869536.594809:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788869536.594821:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 470508233756ns, next at 471508231281ns, rc = 0 00000001:00080000:2.0:1788869536.594839:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:2.0:1788869536.594863:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839cc00) 00010000:00010000:2.0:1788869536.594867:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788869536.594874:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf07d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ed7 expref: 50 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.595070:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28268b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+49:11388:x1875765305076480:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 12831us (12989us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788869536.595080:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000020:00080000:2.0:1788869536.595084:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788869536.598218:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.598306:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305076736 00000100:00100000:2.0:1788869536.598317:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305076736 00000100:00100000:2.0:1788869536.598471:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:2.0:1788869536.598485:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+49:11388:x1875765305076736:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869536.598509:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869536.598533:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf099 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ede expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.598676:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf099 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ede expref: 50 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.598714:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf099 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ede expref: 50 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.598738:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869536.598742:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869536.598746:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb800, rc 0) 00000100:00100000:2.0:1788869536.598864:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+50:11388:x1875765305076736:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 382us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.598871:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:0.0:1788869536.603580:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869536.604309:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305076992 00000100:00100000:3.0:1788869536.604322:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305076992 00000100:00100000:3.0:1788869536.604658:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1788869536.604672:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+50:11388:x1875765305076992:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869536.604979:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+51:11388:x1875765305076992:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 309us (1409us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788869536.604987:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1788869536.680547:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.680679:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305077120 00000100:00100000:1.0:1788869536.680688:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305077120 00000100:00100000:1.0:1788869536.680746:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:1.0:1788869536.680755:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+51:11398:x1875765305077120:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1788869536.680857:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.680895:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.680918:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.680935:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.680942:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.680949:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681032:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681041:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681048:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869536.681097:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681111:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681118:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681139:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681146:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869536.681150:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681158:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681170:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869536.681173:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869536.681178:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681185:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681197:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681203:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681209:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681214:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869536.681217:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681230:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681238:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701eceb00) 00010000:00010000:1.0:1788869536.681240:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869536.681243:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681249:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681257:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681263:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681267:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681272:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869536.681274:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681279:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681286:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:1.0:1788869536.681288:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869536.681290:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.681305:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869536.681392:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+51:11398:x1875765305077120:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 637us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.681401:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1788869536.724713:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.724838:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305077376 00000100:00100000:2.0:1788869536.724849:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305077376 00000100:00100000:2.0:1788869536.724913:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:2.0:1788869536.724925:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+51:11401:x1875765305077376:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869536.724951:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869536.724974:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf0b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ee5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725094:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725111:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725122:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725134:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725151:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725159:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725293:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725303:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725309:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869536.725320:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788869536.725429:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725437:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725444:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725450:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869536.725455:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725463:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725490:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869536.725493:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869536.725500:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725506:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf0bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725522:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725528:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725534:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725538:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869536.725541:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725547:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725555:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701eceb00) 00010000:00010000:2.0:1788869536.725557:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869536.725560:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725565:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725663:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf0b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ee5 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725678:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ee5 expref: 53 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.725685:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869536.725688:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869536.725691:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edba00, rc 0) 00000100:00100000:2.0:1788869536.725767:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:11401:x1875765305077376:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 843us (1067us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788869536.725774:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:0.0:1788869536.731194:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.731296:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305077504 00000100:00100000:1.0:1788869536.731308:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305077504 00000100:00100000:1.0:1788869536.731374:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:1.0:1788869536.731386:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:11401:x1875765305077504:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788869536.731477:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.731495:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.731507:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.731543:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.731550:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.731557:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.731563:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869536.731567:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.731636:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.731649:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:1.0:1788869536.731652:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869536.731657:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.731663:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf0d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869536.731733:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:11401:x1875765305077504:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 350us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.731741:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:3.0:1788869536.734726:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.735008:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305077760 00000100:00100000:2.0:1788869536.735019:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305077760 00000100:00100000:2.0:1788869536.735085:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788869536.735096:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:11401:x1875765305077760:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869536.735366:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+54:11401:x1875765305077760:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 270us (649us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788869536.735373:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1788869536.820654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.820977:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305078016 00000100:00100000:2.0:1788869536.820987:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305078016 00000100:00100000:2.0:1788869536.821053:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:2.0:1788869536.821064:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+54:11411:x1875765305078016:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869536.821089:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869536.821092:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788869536.821140:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf05a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ec9 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.821160:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869536.821166:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869536.821181:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf0df lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9eec expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.821309:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.821323:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ee5 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.821332:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.821365:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ee5 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.821378:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ee5 expref: 54 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.821391:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325089152:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869536.822053:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869536.830199:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325089152:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869536.830232:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869536.833019:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.833114:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305078144 00000100:00100000:2.0:1788869536.833124:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305078144 00010000:00010000:2.0:1788869536.833165:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ee5 expref: 55 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.833203:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1788869536.833212:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:2410:x1875765305078144:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869536.833225:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869536.833231:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ee5 expref: 55 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.833244:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ee5 expref: 55 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.833273:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf0ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ee5 expref: 55 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.833290:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869536.833294:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.833303:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.833310:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.833342:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869536.833421:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+54:2410:x1875765305078144:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 210us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.833428:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00010000:00010000:3.0:1788869536.833728:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.833738:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869536.833761:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788869536.833925:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf0df lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eec expref: 55 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.833942:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eec expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.833950:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:3.0:1788869536.833953:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869536.833955:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda800, rc 0) 00000100:00100000:3.0:1788869536.833998:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+54:11411:x1875765305078016:12345-192.168.204.54@tcp:101:bash.0 Request processed in 12937us (13355us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788869536.834005:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:0.0:1788869536.838452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.838630:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305078272 00000100:00100000:1.0:1788869536.838642:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305078272 00000100:00100000:1.0:1788869536.838702:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:1.0:1788869536.838714:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+54:11411:x1875765305078272:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869536.838743:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869536.838769:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ef3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.838809:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.838833:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.838846:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.838987:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf0f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ef3 expref: 56 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.839007:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ef3 expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.839016:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:1.0:1788869536.839019:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869536.839022:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f400, rc 0) 00000100:00100000:1.0:1788869536.839084:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:11411:x1875765305078272:12345-192.168.204.54@tcp:101:bash.0 Request processed in 373us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.839092:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:1.0:1788869536.843166:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869536.843281:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305078528 00000100:00100000:0.0:1788869536.843293:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305078528 00000100:00100000:0.0:1788869536.843385:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:0.0:1788869536.843397:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:11411:x1875765305078528:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:0.0:1788869536.843804:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.843834:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.843849:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869536.843900:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:0.0:1788869536.843927:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036a59464 reply state 00000000900a4124 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.843940:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869536.843949:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:0.0:1788869536.843951:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869536.843956:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869536.844050:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:11411:x1875765305078528:12345-192.168.204.54@tcp:36:bash.0 Request processed in 655us (896us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788869536.844058:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000020:00080000:0.0:1788869536.844065:0:8260:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788869536.847174:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.847253:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305078656 00000100:00100000:1.0:1788869536.847273:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305078656 00000100:00100000:1.0:1788869536.847328:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1788869536.847337:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:11411:x1875765305078656:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869536.847362:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869536.847383:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf109 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9efa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.847501:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.847516:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eec expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.847536:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.847573:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eec expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.847630:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eec expref: 59 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869536.847646:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325089280:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869536.847723:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869536.851690:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.851829:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325089280:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869536.851858:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.851948:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305078784 00000100:00100000:2.0:1788869536.851959:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305078784 00010000:00010000:2.0:1788869536.851994:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eec expref: 60 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.852032:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:2.0:1788869536.852041:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:2409:x1875765305078784:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869536.852061:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869536.852067:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eec expref: 60 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.852079:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eec expref: 60 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.852104:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf0e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9eec expref: 60 pid: 6526 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.852133:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869536.852138:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.852147:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.852155:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.852197:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869536.852270:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:2409:x1875765305078784:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 228us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.852278:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00010000:00010000:1.0:1788869536.852424:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.852432:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869536.852491:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788869536.852497:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869536.852521:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.852553:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf109 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9efa expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.852633:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9efa expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.852643:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:1.0:1788869536.852645:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869536.852648:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f200, rc 0) 00000100:00100000:1.0:1788869536.852675:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:11411:x1875765305078656:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5339us (5510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.852681:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1788869536.858213:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.858550:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305079040 00000100:00100000:2.0:1788869536.858562:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305079040 00000100:00100000:2.0:1788869536.858670:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1788869536.858683:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:11411:x1875765305079040:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1788869536.858939:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:11411:x1875765305079040:12345-192.168.204.54@tcp:35:bash.0 Request processed in 258us (742us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788869536.858947:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1788869536.933765:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.933906:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305079168 00000100:00100000:2.0:1788869536.933920:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305079168 00000100:00100000:2.0:1788869536.933997:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1788869536.934012:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:11417:x1875765305079168:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869536.934048:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869536.934084:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f01 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.934186:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf11e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.934201:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf11e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.934213:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf11e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869536.934363:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788869536.934368:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869536.934394:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf11e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.934425:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f01 expref: 61 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.934447:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf11e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f01 expref: 60 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.934456:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869536.934459:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869536.934463:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edba00, rc 0) 00000100:00100000:2.0:1788869536.934836:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:11417:x1875765305079168:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 826us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.934844:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:0.0:1788869536.946124:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869536.946370:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305079296 00000100:00100000:3.0:1788869536.946380:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305079296 00000100:00100000:3.0:1788869536.946562:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:3.0:1788869536.946573:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:11417:x1875765305079296:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869536.946660:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869536.946686:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf125 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f08 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.946753:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.946768:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.946779:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.946790:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.946798:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.946805:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.946923:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf13a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.946933:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf13a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.946940:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf13a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869536.946984:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788869536.946995:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869536.947019:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf13a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947032:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf13a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947041:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947047:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947054:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947061:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869536.947065:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947073:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947087:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:3.0:1788869536.947090:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869536.947095:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947101:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf12c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947188:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947205:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947210:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947215:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869536.947218:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947224:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947233:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701eceb00) 00010000:00010000:3.0:1788869536.947235:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869536.947238:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947243:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf133 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947353:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf125 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f08 expref: 62 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947369:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf13a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f08 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.947375:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:3.0:1788869536.947378:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869536.947386:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9a00, rc 0) 00000100:00100000:3.0:1788869536.947532:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:11417:x1875765305079296:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 960us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869536.947540:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1788869536.952354:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869536.952520:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869536.952653:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305079680 00000100:00100000:3.0:1788869536.952664:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305079680 00000100:00100000:3.0:1788869536.952730:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788869536.952743:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704200380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:2410:x1875765305079680:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869536.952766:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869536.952795:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf13a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f08 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.952829:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:3.0:1788869536.952835:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869536.952910:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704200380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:2410:x1875765305079680:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 163us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869536.952918:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788869536.954495:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305079552 00000100:00100000:2.0:1788869536.954510:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305079552 00000100:00100000:2.0:1788869536.954576:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1788869536.954602:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:11417:x1875765305079552:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869536.954624:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869536.954647:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf141 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f0f expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.954760:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.954794:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9efa expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.954803:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.954850:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9efa expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.954866:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9efa expref: 61 pid: 6524 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.954880:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325089408:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869536.955524:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869536.961247:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869536.961677:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305079808 00000100:00100000:3.0:1788869536.961690:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305079808 00010000:00010000:3.0:1788869536.961743:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9efa expref: 62 pid: 6524 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869536.961789:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:3.0:1788869536.961801:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704201880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:2410:x1875765305079808:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869536.961834:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869536.961844:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9efa expref: 62 pid: 6524 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.961880:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9efa expref: 62 pid: 6524 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.961904:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:3.0:1788869536.961910:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.961921:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.961929:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.961949:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869536.962008:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704201880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:2410:x1875765305079808:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 209us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869536.962016:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00010000:00010000:2.0:1788869536.962457:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf110 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9efa expref: 61 pid: 6524 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869536.962478:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325089408:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869536.962514:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.962525:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.962531:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869536.962556:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788869536.962733:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf141 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f0f expref: 62 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.962750:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f0f expref: 61 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.962758:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869536.962761:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869536.962763:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edae00, rc 0) 00000100:00100000:2.0:1788869536.962808:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:11417:x1875765305079552:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 8223us (10468us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788869536.962816:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00010000:00010000:3.0:1788869536.965945:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869536.967973:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869536.968051:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305080064 00000100:00100000:2.0:1788869536.968064:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305080064 00000100:00100000:2.0:1788869536.968157:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788869536.968168:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:11417:x1875765305080064:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:2.0:1788869536.968192:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869536.968221:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf099 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ede expref: 61 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869536.968242:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869536.968248:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869536.968316:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:11417:x1875765305080064:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 150us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.968323:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788869536.971682:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869536.972344:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305080192 00000100:00100000:1.0:1788869536.972358:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305080192 00000100:00100000:1.0:1788869536.972435:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1788869536.972446:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:11417:x1875765305080192:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:1.0:1788869536.972776:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.972798:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869536.972810:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869536.972953:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788869536.973080:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:11417:x1875765305080192:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 636us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869536.973087:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1788869536.976619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869536.976732:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305080320 00000100:00100000:3.0:1788869536.976743:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305080320 00000100:00100000:3.0:1788869536.976859:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:3.0:1788869536.976870:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:11417:x1875765305080320:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869536.976892:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869536.976922:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f16 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.976989:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.977000:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f16 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.977018:0:6526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.977031:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f16 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.977044:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:3.0:1788869536.977047:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869536.977051:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f16 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869536.977059:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9c00, rc 0) 00000100:00100000:3.0:1788869536.977126:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:11417:x1875765305080320:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 259us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869536.977133:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000040:00080000:2.0:1788869537.350086:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869537.350098:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869537.350143:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788869537.350155:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869537.350322:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325089536:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869537.352343:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.365132:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.366405:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305080448 00000100:00100000:3.0:1788869537.366424:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305080448 00000100:00080000:1.0:1788869537.366582:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869537.366823:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:3.0:1788869537.366838:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:11418:x1875765305080448:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788869537.366882:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788869537.367085:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:11418:x1875765305080448:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 251us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.367093:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:2.0:1788869537.367713:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325089536:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869537.379948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869537.380094:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305080576 00000100:00100000:2.0:1788869537.380104:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305080576 00000100:00100000:2.0:1788869537.380187:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:2.0:1788869537.380208:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:11418:x1875765305080576:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788869537.380289:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380306:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380320:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380336:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380342:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380349:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380373:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380418:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380425:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869537.380489:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788869537.380495:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869537.380511:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380523:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380529:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380537:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380543:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.380548:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380557:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380569:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:2.0:1788869537.380572:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.380578:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380628:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf164 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380644:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380649:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380655:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380659:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.380662:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380668:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380676:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8e280839cc00) 00010000:00010000:2.0:1788869537.380678:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.380681:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380686:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf16b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380702:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380708:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380720:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380725:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.380728:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380734:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380742:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869537.380745:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.380747:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.380753:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf172 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.380857:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:11418:x1875765305080576:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 659us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.380865:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:1.0:1788869537.387919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.388075:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305080832 00000100:00100000:0.0:1788869537.388088:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305080832 00000100:00100000:0.0:1788869537.388166:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:0.0:1788869537.388177:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:11418:x1875765305080832:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869537.388198:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869537.388221:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf179 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f1d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388330:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388345:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388356:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869537.388366:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788869537.388446:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388454:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388460:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388466:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869537.388471:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388506:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388519:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:0.0:1788869537.388522:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869537.388527:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388534:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf180 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388572:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf179 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f1d expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388581:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:0.0:1788869537.388583:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869537.388828:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf179 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f1d expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.388840:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8a00, rc 0) 00000100:00100000:0.0:1788869537.388913:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:11418:x1875765305080832:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 738us (1017us total) trans 4294967400 rc 301/301 00000100:00100000:0.0:1788869537.388920:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:1.0:1788869537.392134:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.392232:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305080960 00000100:00100000:0.0:1788869537.392243:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305080960 00000100:00100000:0.0:1788869537.392308:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:0.0:1788869537.392319:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:11418:x1875765305080960:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869537.392382:0:8260:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869537.392553:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:11418:x1875765305080960:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 235us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.392561:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:1.0:1788869537.406297:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.406445:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305081216 00000100:00100000:3.0:1788869537.406455:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305081216 00000100:00100000:3.0:1788869537.406521:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1788869537.406531:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:11418:x1875765305081216:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869537.406555:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869537.406558:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788869537.406634:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf11e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f01 expref: 62 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.406656:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:3.0:1788869537.406662:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869537.406679:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf18e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f24 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788869537.407094:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788869537.407238:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf195 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.407255:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf195 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.407266:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf195 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.407319:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf18e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f24 expref: 64 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.407356:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf195 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f24 expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.407363:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c700) 00010000:00010000:3.0:1788869537.407366:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869537.407370:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9800, rc 0) 00000100:00100000:3.0:1788869537.407435:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+63:11418:x1875765305081216:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 906us (1149us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788869537.407444:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:1.0:1788869537.414616:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.414726:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305081472 00000100:00100000:0.0:1788869537.414736:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305081472 00000100:00100000:0.0:1788869537.414790:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:0.0:1788869537.414818:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+63:11418:x1875765305081472:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869537.414879:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869537.414920:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9800/0x4c16c38a9b6cf195 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f24 expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.414949:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c700) 00010000:00010000:0.0:1788869537.414959:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869537.414981:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.414996:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415006:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415062:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415071:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415102:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415168:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415176:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415183:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415189:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869537.415193:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415201:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415209:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:0.0:1788869537.415212:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869537.415215:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415223:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf1a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415233:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415239:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415252:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415256:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869537.415259:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415264:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415271:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xeef5509c (ffff8e2809bdc800) 00010000:00010000:0.0:1788869537.415274:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869537.415276:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.415281:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xeef5509c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.415372:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:11418:x1875765305081472:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 572us (798us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869537.415378:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:1.0:1788869537.422511:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.423013:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305081600 00000100:00100000:3.0:1788869537.423024:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305081600 00000100:00100000:3.0:1788869537.423093:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:3.0:1788869537.423104:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:11418:x1875765305081600:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869537.423124:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869537.423151:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f2b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.423193:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.423210:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.423222:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.423347:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f2b expref: 64 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.423375:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f2b expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.423384:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:3.0:1788869537.423400:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869537.423403:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8e00, rc 0) 00000100:00100000:3.0:1788869537.423723:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+63:11418:x1875765305081600:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 619us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.423731:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:1.0:1788869537.430238:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.430336:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305081856 00000100:00100000:0.0:1788869537.430347:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305081856 00000100:00100000:0.0:1788869537.430419:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:0.0:1788869537.430431:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+63:11418:x1875765305081856:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869537.430539:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.430557:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.430616:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869537.431042:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788869537.431055:0:8260:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471344466975ns, next at 472344463714ns, rc = 0 00000004:00010000:0.0:1788869537.431110:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b987746 reply state 00000000ed21ba47 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.431125:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.431133:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:0.0:1788869537.431136:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788869537.431141:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869537.431238:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:11418:x1875765305081856:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 809us (1010us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788869537.431245:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:1.0:1788869537.440320:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.440433:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305081984 00000100:00100000:0.0:1788869537.440444:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305081984 00000100:00100000:0.0:1788869537.440522:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:0.0:1788869537.440534:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:11418:x1875765305081984:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869537.440559:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869537.440580:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f32 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.440683:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f32 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.440721:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f32 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.440741:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:0.0:1788869537.440744:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869537.440748:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8200, rc 0) 00000100:00100000:0.0:1788869537.440796:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:11418:x1875765305081984:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 265us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.440804:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:1.0:1788869537.448364:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.449751:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305082112 00000100:00100000:3.0:1788869537.449765:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305082112 00000100:00100000:3.0:1788869537.449873:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788869537.449885:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2407:x1875765305082112:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788869537.450164:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2407:x1875765305082112:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 280us (1810us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788869537.450172:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00080000:1.0:1788869537.451021:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869537.459165:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869537.459310:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305082368 00000100:00100000:2.0:1788869537.459323:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305082368 00000100:00100000:2.0:1788869537.459505:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1788869537.459519:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:11418:x1875765305082368:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788869537.459855:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:11418:x1875765305082368:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 338us (705us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788869537.459863:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788869537.469107:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.469663:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305082624 00000100:00100000:3.0:1788869537.469676:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305082624 00000100:00100000:3.0:1788869537.469744:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:3.0:1788869537.469756:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:11418:x1875765305082624:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788869537.470036:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:11418:x1875765305082624:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 280us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.470045:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:1.0:1788869537.475729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869537.476128:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305082752 00000100:00100000:2.0:1788869537.476142:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305082752 00000100:00100000:2.0:1788869537.476216:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:2.0:1788869537.476226:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:11418:x1875765305082752:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869537.476249:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869537.476273:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf1cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f39 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.476349:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf1d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.476366:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.476378:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869537.476439:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869537.476460:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.478110:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf1cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f39 expref: 69 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.478143:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f39 expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.478153:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:2.0:1788869537.478156:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788869537.478160:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda800, rc 0) 00000100:00100000:2.0:1788869537.478252:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:11418:x1875765305082752:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2026us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.478261:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:1.0:1788869537.484830:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869537.484923:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305082880 00000100:00100000:2.0:1788869537.484933:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305082880 00000100:00100000:2.0:1788869537.484992:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1788869537.485004:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2408:x1875765305082880:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869537.485024:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869537.485047:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f40 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869537.485074:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffba0, blocks: 0x0 00010000:00010000:2.0:1788869537.485095:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788869537.485100:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869537.485110:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f40 expref: 10 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.485130:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f40 expref: 10 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.485143:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda000, rc 0) 00000100:00100000:2.0:1788869537.485216:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:2408:x1875765305082880:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 213us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.485224:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788869537.488904:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.489241:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305083136 00000100:00100000:3.0:1788869537.489268:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305083136 00000100:00100000:3.0:1788869537.489348:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:3.0:1788869537.489360:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:11418:x1875765305083136:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788869537.489501:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:11418:x1875765305083136:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 143us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.489509:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:3.0:1788869537.498162:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.498343:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305083264 00000100:00100000:0.0:1788869537.498359:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305083264 00000100:00100000:0.0:1788869537.498441:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1788869537.498456:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:11418:x1875765305083264:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869537.498487:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869537.498512:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f47 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.498548:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f40 expref: 11 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.498569:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869537.498573:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869537.498579:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 11 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.498691:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f40 expref: 11 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.498707:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f40 expref: 11 pid: 8442 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.498722:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704201180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1875765325089664:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869537.498840:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.508820:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.508981:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704201180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1875765325089664:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869537.509028:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 11 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.509048:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8a00, rc 0) 00000100:00100000:0.0:1788869537.509120:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:11418:x1875765305083264:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 10669us (10974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.509130:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1788869537.509557:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305083392 00000100:00100000:3.0:1788869537.509565:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305083392 00010000:00010000:3.0:1788869537.509637:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f40 expref: 11 pid: 8442 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.509663:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1788869537.509671:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:2410:x1875765305083392:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869537.509684:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869537.509712:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f40 expref: 11 pid: 8442 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.509725:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f40 expref: 11 pid: 8442 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.509750:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd3e6c8b/0x4c16c38a9b6cf1db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f40 expref: 11 pid: 8442 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.509763:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869537.509767:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869537.509794:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 10 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.509820:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 10 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.509857:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 10 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.509872:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875765325089792:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788869537.509941:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.520245:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875765325089792:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788869537.520276:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869537.520349:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:2410:x1875765305083392:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 10677us (11553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.520361:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:1.0:1788869537.525576:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.526376:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305083520 00000100:00100000:3.0:1788869537.526460:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305083520 00002000:00100000:3.0:1788869537.526583:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8e282f05b100 x1875765305083520/t0(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:483/0 lens 504/0 e 0 to 0 dl 1788869548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869537.526618:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e282f05b100 with x1875765305083520 ext(0->12) 00002000:00010000:3.0:1788869537.526625:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e282f05b100 00000100:00100000:3.0:1788869537.526713:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788869537.526723:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:2407:x1875765305083520:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788869537.528028:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:2407:x1875765305083520:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 1300us (2455us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788869537.528052:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:3.0:1788869537.528064:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8e282f05b100 x1875765305083520/t4294967309(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:483/0 lens 504/448 e 0 to 0 dl 1788869548 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869537.528074:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e282f05b100 with x1875765305083520 ext(0->12) 00002000:00010000:3.0:1788869537.528080:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e282f05b100 00000100:00100000:1.0:1788869537.538148:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.538257:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305083648 00000100:00100000:0.0:1788869537.538268:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305083648 00000100:00100000:0.0:1788869537.538342:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:0.0:1788869537.538353:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:11418:x1875765305083648:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788869537.543420:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:1.0:1788869537.543444:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:2.0:1788869537.543543:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543574:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543583:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543626:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.543632:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543641:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543660:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e2809bdc300) 00010000:00010000:2.0:1788869537.543663:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.543668:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543675:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6ceee7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543703:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543710:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543716:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543720:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.543731:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543738:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543746:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e2701ece800) 00010000:00010000:2.0:1788869537.543749:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.543752:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543758:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cef8f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543788:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543796:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543825:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543830:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.543833:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543838:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543845:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701eceb00) 00010000:00010000:2.0:1788869537.543848:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.543857:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543863:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf00d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543875:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543881:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543887:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543891:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.543895:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543901:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543909:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e2701eceb00) 00010000:00010000:2.0:1788869537.543912:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.543914:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543920:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf030 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543939:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543959:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543966:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543971:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.543974:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543981:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.543990:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869537.543993:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.543996:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544002:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf102 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544015:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544022:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544027:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544032:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.544042:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544049:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544058:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:2.0:1788869537.544061:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869537.544064:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544071:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869537.544362:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788869537.544396:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e280a0a89c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788869537.544401:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e28411d5d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e280a0a8540 00000020:00080000:1.0:1788869537.544404:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e28411d5800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2702befa00 00000004:00080000:1.0:1788869537.544433:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1788869537.544567:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325089920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788869537.544672:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.544734:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325089920 00000100:00100000:2.0:1788869537.544743:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325089920 00000100:00100000:2.0:1788869537.544792:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869537.544820:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3649:x1875765325089920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788869537.544846:0:11338:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1788869537.544878:0:11338:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ffb9f, atime: 0x6a9ffb9f, ctime: 0x6a9ffb9f, blocks: 0x8 00010000:00010000:2.0:1788869537.544886:0:11338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544902:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788869537.544907:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869537.544913:0:11338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544941:0:11338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544951:0:11338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544959:0:11338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.544978:0:11338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788869537.545160:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3649:x1875765325089920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 357us (486us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788869537.545169:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1788869537.545199:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869537.545206:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.545215:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869537.545219:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.545229:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.545243:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.545256:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a680895/0x4c16c38a9b6cf1e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.545275:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869537.545277:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869537.545279:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788869537.545315:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e282f0bd500/2, rc 0, transno 4294967305 00000100:00100000:2.0:1788869537.545321:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325089920:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788869537.545619:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788869537.551994:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325090048:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788869537.552074:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.552128:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869537.552135:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325090176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788869537.552157:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.552194:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325090048 00000100:00100000:3.0:1788869537.552203:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325090048 00000100:00100000:3.0:1788869537.552260:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325090176 00000100:00100000:3.0:1788869537.552264:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325090176 00000100:00100000:3.0:1788869537.552292:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869537.552302:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1875765325090048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788869537.552331:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1788869537.552362:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.552398:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e9f expref: 11 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.552408:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788869537.552427:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869537.552432:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.552462:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e9f expref: 11 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.552477:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e9f expref: 11 pid: 8743 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.552490:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1875765325090304:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869537.552563:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703952840 going to sleep for 11 seconds 00000100:00080000:3.0:1788869537.552577:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869537.552621:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869537.552629:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3650:x1875765325090176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788869537.552745:0:11338:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788869537.552749:0:11338:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788869536 00002000:00010000:3.0:1788869537.552751:0:11338:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788869537.552753:0:11338:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788869536 -> 1788869536 00002000:00010000:3.0:1788869537.552755:0:11338:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788869537.552799:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3650:x1875765325090176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (640us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788869537.552818:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788869537.552858:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2704201c00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788869537.552864:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325090176:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1788869537.554131:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e27039b6240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788869537.554141:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2802d5f300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e282a37bc00 00000020:00080000:1.0:1788869537.554144:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2802d5f000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e28142d7000 00000100:00100000:2.0:1788869537.556349:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:11418:x1875765305083648:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 17983us (18415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.556363:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 136 00000001:00080000:1.0:1788869537.559692:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1788869537.559716:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000020:00080000:3.0:1788869537.561755:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1788869537.565863:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1875765325090304:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869537.565907:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788869537.569962:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788869537.572876:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869537.572962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.573218:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305083904 00000100:00100000:0.0:1788869537.573229:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305083904 00000100:00100000:0.0:1788869537.573290:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1788869537.573301:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:2410:x1875765305083904:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788869537.578070:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788869537.578089:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1788869537.578278:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305083904:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 4973us (5309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.578290:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1788869537.578784:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305083776 00000100:00100000:3.0:1788869537.578795:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305083776 00010000:00010000:3.0:1788869537.578848:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e9f expref: 7 pid: 8743 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.578888:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:3.0:1788869537.578907:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2409:x1875765305083776:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869537.578923:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869537.578929:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e9f expref: 7 pid: 8743 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.578942:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e9f expref: 7 pid: 8743 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.578965:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cef9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e9f expref: 7 pid: 8743 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.578982:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869537.578986:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869537.578991:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.579000:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.579037:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869537.579082:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305083776:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 177us (6220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.579090:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00010000:00010000:2.0:1788869537.579432:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.579441:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.579451:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.579458:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.579504:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788869537.579752:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765325090048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27451us (27677us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788869537.579762:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1788869537.580402:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869537.580411:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.580421:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869537.580426:0:7475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.580436:0:7475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.580452:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.580460:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf1f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.580491:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869537.580494:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869537.580496:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869537.580537:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788869537.580544:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1788869537.580566:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2704201c00, transno 4294967310 00000100:00100000:3.0:1788869537.580610:0:3650:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e2704201180 x1875765325090048/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788869537.580638:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2704201180/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788869537.580644:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325090048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788869537.593161:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.593369:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305084160 00000100:00100000:3.0:1788869537.593379:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305084160 00000100:00100000:3.0:1788869537.593545:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:3.0:1788869537.593557:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:11418:x1875765305084160:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869537.593636:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869537.593669:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf1d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f39 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.593688:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:3.0:1788869537.593693:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869537.593724:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.593738:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.593747:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869537.593906:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d01d9392 reply state 00000000920a1d36 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.593921:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.593928:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:3.0:1788869537.593948:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869537.593953:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869537.594077:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:11418:x1875765305084160:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 523us (930us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1788869537.594084:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:0.0:1788869537.599978:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.600075:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305084288 00000100:00100000:3.0:1788869537.600085:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305084288 00000100:00100000:3.0:1788869537.600177:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788869537.600188:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305084288:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869537.600356:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788869537.600360:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788869536 -> 1788869535 00002000:00010000:3.0:1788869537.600363:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788869535 00002000:00010000:3.0:1788869537.600365:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788869536 -> 1788869535 00002000:00010000:3.0:1788869537.600368:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788869537.600575:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2409:x1875765305084288:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 388us (686us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788869537.600583:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1788869537.610462:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.610543:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305084544 00000100:00100000:0.0:1788869537.610555:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305084544 00000100:00100000:0.0:1788869537.610651:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:0.0:1788869537.610662:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:11418:x1875765305084544:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788869537.610740:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.610760:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f2b expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.610771:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.610822:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f2b expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.610838:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f2b expref: 17 pid: 6525 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.610881:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325090432:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869537.610983:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.614344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.614473:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305084672 00000100:00100000:3.0:1788869537.614485:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305084672 00010000:00010000:3.0:1788869537.614530:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f2b expref: 18 pid: 6525 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.614575:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1788869537.614623:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:2410:x1875765305084672:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869537.614640:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869537.614648:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f2b expref: 18 pid: 6525 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.614689:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f2b expref: 18 pid: 6525 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.614712:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:3.0:1788869537.614716:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.614726:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.614733:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.614750:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869537.614796:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:2410:x1875765305084672:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 213us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.614803:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00010000:00010000:0.0:1788869537.615392:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf1b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f2b expref: 17 pid: 6525 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.615412:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325090432:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869537.615436:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.615446:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.615452:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.615492:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.615500:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.615507:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.615514:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869537.615517:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.615539:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.615551:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:0.0:1788869537.615554:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788869537.615558:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.615564:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf1fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.615719:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:11418:x1875765305084544:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 5058us (5268us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788869537.615727:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:1.0:1788869537.624159:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869537.624880:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305084800 00000100:00100000:2.0:1788869537.624893:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305084800 00000100:00100000:2.0:1788869537.624966:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1788869537.624978:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305084800:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788869537.625025:0:11338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.625047:0:11338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.625055:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869537.625060:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869537.625065:0:11338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.625103:0:11338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.625118:0:11338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 7 pid: 8443 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.625153:0:11338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11338:1875765325090560:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869537.625423:0:11338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.633097:0:11338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11338:1875765325090560:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869537.633135:0:11338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869537.633990:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.635898:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305084928 00000100:00100000:3.0:1788869537.635916:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305084928 00010000:00010000:2.0:1788869537.636147:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 8 pid: 8443 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.636203:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:2.0:1788869537.636214:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305084928:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869537.636231:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869537.636254:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 8 pid: 8443 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.636268:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 8 pid: 8443 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.636293:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000453f3c81/0x4c16c38a9b6cf1e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f47 expref: 8 pid: 8443 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.636311:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869537.636315:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869537.636321:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.636331:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.636398:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869537.636462:0:11338:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.636466:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305084928:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 254us (2481us total) trans 0 rc 0/0 00010000:00010000:3.0:1788869537.636473:0:11338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.636482:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00010000:00010000:3.0:1788869537.636500:0:11338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.636509:0:11338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.636517:0:11338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.636525:0:11338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869537.636529:0:11338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.636538:0:11338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.636551:0:11338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.636559:0:11338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6cf205 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.636652:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305084800:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 11677us (12506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.636668:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1788869537.640736:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.640831:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305085184 00000100:00100000:0.0:1788869537.640841:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305085184 00000100:00100000:0.0:1788869537.640910:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00100000:0.0:1788869537.640922:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:11418:x1875765305085184:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788869537.641144:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.641163:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ef3 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.641172:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.641207:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ef3 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.641238:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ef3 expref: 16 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.641253:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325090688:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869537.641341:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.646164:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.646430:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325090688:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869537.646474:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.646624:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305085312 00000100:00100000:3.0:1788869537.646633:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305085312 00010000:00010000:3.0:1788869537.646676:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ef3 expref: 17 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.646719:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1788869537.646728:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:2409:x1875765305085312:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869537.646749:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869537.646758:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ef3 expref: 17 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.646769:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ef3 expref: 17 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.646792:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf0fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ef3 expref: 17 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.646821:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:3.0:1788869537.646828:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f16 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.646838:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.646846:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.646871:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.646892:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869537.647058:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:2409:x1875765305085312:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 329us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.647066:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00010000:00010000:0.0:1788869537.647124:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.647135:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.647315:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.647327:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f32 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.647335:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.647364:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f32 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.647377:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f32 expref: 16 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.647411:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325090816:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869537.647475:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.654321:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325090816:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869537.654367:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869537.658549:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869537.658785:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305085440 00000100:00100000:2.0:1788869537.658796:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305085440 00010000:00010000:2.0:1788869537.658850:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f32 expref: 17 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.658889:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:2.0:1788869537.658900:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:2407:x1875765305085440:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869537.658922:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869537.658929:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f32 expref: 17 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.658944:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f32 expref: 17 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.658972:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf1c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f32 expref: 17 pid: 6524 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.658991:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:2.0:1788869537.658997:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.659025:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.659033:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.659078:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869537.659145:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:2407:x1875765305085440:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 245us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.659153:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00010000:00010000:1.0:1788869537.659266:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.659274:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869537.659418:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788869537.659547:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:1.0:1788869537.659631:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788869537.659732:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325090944:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788869537.659791:0:8260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.659831:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.662203:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325090944 00000100:00100000:0.0:1788869537.662220:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325090944 00000100:00100000:0.0:1788869537.662296:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788869537.662306:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8260:x1875765325090944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788869537.663187:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8260:x1875765325090944:12345-0@lo:1000:mdt00_003.0 Request processed in 868us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.663203:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788869537.663468:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325090944:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788869537.663916:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:1.0:1788869537.664002:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325091072:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788869537.664047:0:8260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.664136:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a37b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.664276:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325091072 00000100:00100000:3.0:1788869537.664284:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325091072 00000100:00100000:3.0:1788869537.664366:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788869537.664377:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8260:x1875765325091072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788869537.664532:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8260:x1875765325091072:12345-0@lo:1000:mdt00_003.0 Request processed in 157us (484us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788869537.664539:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788869537.664637:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325091072:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788869537.664679:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664689:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664696:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664702:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869537.664707:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664733:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664749:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:0.0:1788869537.664752:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869537.664758:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664764:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf213 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664788:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664794:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664801:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664816:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869537.664819:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664825:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664833:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:0.0:1788869537.664835:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869537.664842:0:8260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f16 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664865:0:8260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f16 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664874:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f16 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.664900:0:8260:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f16 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.664912:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325091200:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788869537.664983:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.670116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869537.670230:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325091200:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788869537.670265:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670276:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf156 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670315:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670329:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670340:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670352:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670374:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670381:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670386:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869537.670404:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.670412:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305085568 00010000:00010000:0.0:1788869537.670412:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.670420:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305085568 00010000:00010000:0.0:1788869537.670424:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:0.0:1788869537.670427:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869537.670430:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670436:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf21a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670446:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670451:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670456:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670462:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869537.670471:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.670478:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.670487:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00010000:00010000:0.0:1788869537.670487:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:0.0:1788869537.670489:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869537.670492:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.670498:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11417:x1875765305085568:12345-192.168.204.54@tcp:49:lfs.0 00010000:00010000:0.0:1788869537.670498:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf20c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869537.670780:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869537.670792:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869537.671281:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788869537.671293:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869537.671751:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:11417:x1875765305085568:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 168us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.671763:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1788869537.672074:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:11418:x1875765305085184:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 31152us (31348us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788869537.672084:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 139 00000020:00080000:0.0:1788869537.672090:0:8260:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788869537.674619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.674823:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305085824 00000100:00100000:3.0:1788869537.674834:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305085824 00000100:00100000:3.0:1788869537.674898:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788869537.674909:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28268b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:11418:x1875765305085824:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788869537.675206:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788869537.675259:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:3.0:1788869537.675293:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.675310:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.675323:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.675331:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.675337:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.675343:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.675418:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869537.675531:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28268b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:11418:x1875765305085824:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 623us (955us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788869537.675538:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000020:00080000:3.0:1788869537.675543:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788869537.676881:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869537.676956:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305086080 00000100:00100000:2.0:1788869537.676966:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305086080 00000100:00100000:2.0:1788869537.677018:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:2.0:1788869537.677028:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:11417:x1875765305086080:12345-192.168.204.54@tcp:58:lfs.0 00000040:00080000:2.0:1788869537.677199:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788869537.677283:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:11417:x1875765305086080:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 256us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.677291:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 140 00010000:00010000:1.0:1788869537.677976:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869537.677988:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.678000:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869537.678004:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.678016:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.678035:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:1.0:1788869537.678038:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788869537.678043:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.678049:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf221 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.678064:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869537.678066:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869537.678068:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869537.723071:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.723183:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305086208 00000100:00100000:3.0:1788869537.723207:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305086208 00000100:00100000:3.0:1788869537.723286:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:3.0:1788869537.723298:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:11420:x1875765305086208:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869537.723339:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869537.723369:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf228 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f4e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723493:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723510:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723524:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723538:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723545:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723553:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723898:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723910:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f0f expref: 22 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723918:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723954:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f0f expref: 22 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.723981:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f0f expref: 22 pid: 8260 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.723997:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325091328:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869537.724148:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703952e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.728728:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325091328:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869537.728769:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.730732:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869537.731078:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305086464 00000100:00100000:3.0:1788869537.731089:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305086464 00000100:00100000:3.0:1788869537.731160:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788869537.731172:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:6178:x1875765305086464:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788869537.731485:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:6178:x1875765305086464:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 315us (764us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788869537.731494:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788869537.736020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869537.736472:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305086592 00000100:00100000:2.0:1788869537.736484:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305086592 00010000:00010000:2.0:1788869537.736547:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f0f expref: 24 pid: 8260 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.737257:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:2.0:1788869537.737274:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:2410:x1875765305086592:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869537.737296:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869537.737304:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f0f expref: 24 pid: 8260 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.737322:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f0f expref: 24 pid: 8260 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.737351:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf148 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f0f expref: 24 pid: 8260 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.737370:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869537.737376:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.738074:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.738087:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.738363:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869537.738457:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:2410:x1875765305086592:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1186us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.738466:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00010000:00010000:3.0:1788869537.739994:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.740011:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869537.742554:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788869537.742567:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869537.742633:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742660:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742673:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742680:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742689:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742696:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.742700:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742709:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742728:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:2.0:1788869537.742731:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.742737:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742743:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf22f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742760:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742787:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742792:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742814:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869537.742817:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742823:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742831:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e270365c000) 00010000:00010000:2.0:1788869537.742834:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869537.742837:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742843:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf236 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742895:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf228 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f4e expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742909:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f4e expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.742917:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869537.742919:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869537.742928:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8a00, rc 0) 00000100:00100000:2.0:1788869537.743009:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:11420:x1875765305086208:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 19711us (19951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.743019:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 141 00010000:00010000:2.0:1788869537.990036:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869538.121919:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869538.121954:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325091456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869538.122035:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869538.122466:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325091456 00000100:00100000:2.0:1788869538.122475:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325091456 00000100:00100000:2.0:1788869538.122538:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788869538.122548:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325091456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869538.122611:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788869538.122673:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325091456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869538.122681:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788869538.122728:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325091456:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788869538.667946:0:14269:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869538.667956:0:14269:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869538.667997:0:14269:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788869538.668007:0:14269:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788869538.698963:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869538.698974:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869538.699025:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788869538.699039:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869538.699196:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ebb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325091584:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869538.699299:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a37bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869538.705446:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ebb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325091584:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869538.708416:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869538.708513:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305086720 00000100:00100000:2.0:1788869538.708524:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305086720 00000100:00100000:2.0:1788869538.708619:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:2.0:1788869538.708630:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:11432:x1875765305086720:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788869538.708670:0:6524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788869538.708802:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:11432:x1875765305086720:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 174us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869538.708811:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:3.0:1788869538.717583:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869538.717992:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305086976 00000100:00100000:1.0:1788869538.718003:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305086976 00000100:00100000:1.0:1788869538.718073:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:1.0:1788869538.718085:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:11432:x1875765305086976:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869538.718122:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869538.718148:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf244 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f55 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869538.718271:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf24b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869538.718286:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf24b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869538.718300:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf24b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869538.718312:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788869538.718417:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf244 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f55 expref: 25 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869538.718437:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf24b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f55 expref: 24 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869538.718446:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:1.0:1788869538.718449:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869538.718471:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f400, rc 0) 00000100:00100000:1.0:1788869538.718547:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:11432:x1875765305086976:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 464us (976us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788869538.718555:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:3.0:1788869538.726891:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869538.726984:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305087232 00000100:00100000:2.0:1788869538.726995:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305087232 00000100:00100000:2.0:1788869538.727073:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:2.0:1788869538.727092:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:11432:x1875765305087232:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788869538.727203:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869538.727223:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869538.727239:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869538.727438:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869538.727446:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869538.727454:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869538.727460:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869538.727466:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869538.727475:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869538.727491:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:2.0:1788869538.727494:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869538.727500:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869538.727507:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf259 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869538.727805:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:11432:x1875765305087232:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 713us (925us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788869538.727814:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 144 00000040:00080000:1.0:1788869538.729524:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869538.729535:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869538.730417:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788869538.730433:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869538.730759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869538.731024:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305087360 00000100:00100000:0.0:1788869538.731036:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305087360 00000100:00100000:0.0:1788869538.731109:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1788869538.731119:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:2408:x1875765305087360:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869538.731135:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869538.731163:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf24b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f55 expref: 25 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869538.731203:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:0.0:1788869538.731208:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869538.731313:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:2408:x1875765305087360:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 195us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869538.731326:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1788869538.732735:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869538.732853:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305087616 00000100:00100000:0.0:1788869538.732862:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305087616 00000100:00100000:0.0:1788869538.738501:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1788869538.738537:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:11432:x1875765305087616:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869538.738843:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:11432:x1875765305087616:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 323us (6113us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788869538.738852:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00010000:00010000:3.0:1788869539.013896:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869539.145161:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325091712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869539.145247:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869539.145440:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869539.145451:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325091840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869539.145480:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869539.145517:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325091712 00000100:00100000:2.0:1788869539.145524:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325091712 00000100:00100000:2.0:1788869539.145614:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325091840 00000100:00100000:2.0:1788869539.145617:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325091840 00000100:00100000:2.0:1788869539.145636:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788869539.145646:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325091712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869539.145682:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788869539.145729:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325091712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869539.145736:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788869539.145773:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869539.145790:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325091840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869539.145800:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788869539.145827:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325091840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869539.145833:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869539.145879:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325091840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869539.145908:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325091712:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788869539.147094:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869540.038948:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869540.170728:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869540.170763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325091968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869540.170843:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869540.171028:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325091968 00000100:00100000:0.0:1788869540.171037:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325091968 00000100:00100000:0.0:1788869540.171087:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788869540.171099:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325091968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869540.171140:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869540.171189:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325091968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869540.171196:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788869540.171285:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325091968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869540.292352:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869540.292393:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869540.292422:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869540.292531:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305088128 00000100:00100000:3.0:1788869540.292557:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305088128 00000100:00100000:3.0:1788869540.292670:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:3.0:1788869540.292682:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305088128:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869540.292769:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2409:x1875765305088128:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 89us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869540.292776:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00080000:3.0:1788869540.292803:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869540.293078:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869540.293110:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869540.297193:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869540.297227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869540.297637:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305088256 00000100:00100000:2.0:1788869540.297650:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305088256 00000100:00100000:2.0:1788869540.297733:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:2.0:1788869540.297743:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305088256:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869540.297828:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305088256:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 86us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.297837:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:1.0:1788869540.298899:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305087872 00000100:00100000:1.0:1788869540.298911:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305087872 00000100:00100000:1.0:1788869540.298970:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305088384 00000100:00100000:1.0:1788869540.298974:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305088384 00000100:00100000:1.0:1788869540.298989:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305088000 00000100:00100000:1.0:1788869540.298992:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305088000 00000100:00100000:1.0:1788869540.299016:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 333 00000100:00100000:1.0:1788869540.299026:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:2409:x1875765305087872:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869540.299103:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:2409:x1875765305087872:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 78us (6762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869540.299111:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 333 00000100:00100000:1.0:1788869540.299148:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 334 00000100:00100000:1.0:1788869540.299155:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305088384:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869540.299200:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305088384:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 45us (6777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869540.299206:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 334 00000100:00100000:1.0:1788869540.299221:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 335 00000100:00100000:1.0:1788869540.299228:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305088000:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869540.299250:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2409:x1875765305088000:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (6140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869540.299256:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 335 00000100:00080000:2.0:1788869540.299651:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869540.299666:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869540.299668:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869540.299943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305087744 00000100:00100000:1.0:1788869540.299950:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305087744 00000100:00100000:1.0:1788869540.299990:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 392 00000100:00100000:1.0:1788869540.299997:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2409:x1875765305087744:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869540.300032:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2409:x1875765305087744:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (6954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869540.300039:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 392 00000100:00100000:1.0:1788869540.301558:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305088512 00000100:00100000:1.0:1788869540.301571:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305088512 00000100:00100000:1.0:1788869540.301729:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 336 00000100:00100000:1.0:1788869540.301740:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305088512:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869540.301826:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2409:x1875765305088512:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 87us (4597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869540.301833:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 336 00000100:00080000:2.0:1788869540.302872:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1788869540.728049:0:14320:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869540.728062:0:14320:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869540.728113:0:14320:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788869540.728123:0:14320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869540.903292:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869540.903785:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305088768 00000100:00100000:1.0:1788869540.903799:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305088768 00000100:00100000:1.0:1788869540.903921:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:1.0:1788869540.903932:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:11453:x1875765305088768:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869540.903960:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869540.903981:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf260 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f5c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869540.904122:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf267 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869540.904140:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf267 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869540.904157:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf267 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869540.904170:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788869540.904301:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf260 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f5c expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869540.904322:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf267 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f5c expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869540.904332:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:1.0:1788869540.904335:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788869540.904338:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e800, rc 0) 00000100:00100000:1.0:1788869540.904424:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+27:11453:x1875765305088768:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 494us (1145us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788869540.904438:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:2.0:1788869540.908083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869540.908187:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305088896 00000100:00100000:0.0:1788869540.908198:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305088896 00000100:00100000:0.0:1788869540.908269:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:0.0:1788869540.908281:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+27:11453:x1875765305088896:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1788869540.908458:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869540.908477:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869540.908489:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869540.908527:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869540.908534:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869540.908542:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869540.908548:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869540.908552:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869540.908560:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869540.908582:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:0.0:1788869540.908643:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869540.908650:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869540.908657:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf275 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869540.908846:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+27:11453:x1875765305088896:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 558us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869540.908855:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:2.0:1788869541.008377:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869541.008766:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305089024 00000100:00100000:3.0:1788869541.008775:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305089024 00000100:00100000:3.0:1788869541.008828:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1788869541.008841:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305089024:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1788869541.008860:0:11338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869541.008880:0:11338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004788d3d/0x4c16c38a9b6cf27c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f63 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869541.008905:0:11338:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ffb9f, atime: 0x6a9ffb9f, ctime: 0x6a9ffb9f, blocks: 0x8 00010000:00010000:3.0:1788869541.008925:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788869541.008929:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869541.008938:0:11338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004788d3d/0x4c16c38a9b6cf27c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f63 expref: 7 pid: 11338 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869541.008956:0:11338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004788d3d/0x4c16c38a9b6cf27c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f63 expref: 7 pid: 11338 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869541.008969:0:11338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9800, rc 0) 00000100:00100000:3.0:1788869541.009031:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2408:x1875765305089024:12345-192.168.204.54@tcp:101:cat.0 Request processed in 193us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.009049:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1788869541.013249:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869541.013851:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305089152 00000100:00100000:0.0:1788869541.013866:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305089152 00002000:00100000:0.0:1788869541.013931:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8e2704191180 x1875765305089152/t0(0) o3->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:487/0 lens 488/0 e 0 to 0 dl 1788869552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788869541.013944:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2704191180 with x1875765305089152 ext(0->4095) 00002000:00010000:0.0:1788869541.013950:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2704191180 00000100:00100000:0.0:1788869541.013985:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788869541.013995:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2407:x1875765305089152:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:0.0:1788869541.014196:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2407:x1875765305089152:12345-192.168.204.54@tcp:3:cat.0 Request processed in 202us (958us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788869541.014204:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00002000:00100000:0.0:1788869541.014211:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8e2704191180 x1875765305089152/t0(0) o3->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:487/0 lens 488/4536 e 0 to 0 dl 1788869552 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788869541.014218:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2704191180 with x1875765305089152 ext(0->4095) 00002000:00010000:0.0:1788869541.014237:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2704191180 00010000:00010000:2.0:1788869541.065466:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869541.189875:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325092096:0@lo:400:kworker.0 00000100:00100000:0.0:1788869541.189968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869541.190147:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325092096 00000100:00100000:1.0:1788869541.190160:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325092096 00000100:00100000:1.0:1788869541.190227:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788869541.190238:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325092096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869541.190844:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325092224:0@lo:400:kworker.0 00000100:00100000:2.0:1788869541.190893:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869541.190948:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325092224 00000100:00100000:2.0:1788869541.190952:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325092224 00000100:00100000:2.0:1788869541.190989:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788869541.190997:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325092224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869541.191036:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325092224:12345-0@lo:400:kworker.0 Request processed in 41us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869541.191043:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788869541.191088:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325092224:0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.200237:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3648:x1875765325092096:12345-0@lo:400:kworker.0 Request processed in 9993us (10261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869541.200254:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788869541.200323:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325092480:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.200380:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869541.200568:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325092992:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.200613:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869541.200633:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325093504:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.200652:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869541.200677:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788869541.200682:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325092352:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.200703:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869541.200722:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325092864:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.200754:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869541.200779:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325093376:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.200799:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869541.200837:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325092480 00000100:00100000:3.0:1788869541.200848:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325092480 00000100:00100000:3.0:1788869541.200905:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325092864 00000100:00100000:3.0:1788869541.200908:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325092864 00000100:00100000:3.0:1788869541.200936:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325093376 00000100:00100000:3.0:1788869541.200939:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325093376 00000100:00100000:3.0:1788869541.200956:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788869541.200964:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325092480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.201022:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325092480:12345-0@lo:400:kworker.0 Request processed in 59us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.201029:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788869541.201058:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788869541.201063:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325092864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.201094:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325092864:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.201100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788869541.201112:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788869541.201117:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325093376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.201143:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325093376:12345-0@lo:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.201149:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788869541.201166:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325092992 00000100:00100000:3.0:1788869541.201170:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325092992 00000100:00100000:1.0:1788869541.201186:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325092352 00000100:00100000:1.0:1788869541.201190:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325092352 00000100:00100000:3.0:1788869541.201193:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325093504 00000100:00100000:3.0:1788869541.201196:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325093504 00000100:00100000:3.0:1788869541.201213:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788869541.201218:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788869541.201219:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325092992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.201222:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325092352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.201249:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325092992:12345-0@lo:400:kworker.0 Request processed in 30us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869541.201251:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325092352:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.201255:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788869541.201257:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788869541.201265:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869541.201270:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325093504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.201287:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325092736:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.201296:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325093504:12345-0@lo:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.201301:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788869541.201310:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788869541.201315:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869541.201319:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869541.201322:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869541.201724:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325092736 00000100:00100000:1.0:1788869541.201725:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325093248:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.201729:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325092736 00000100:00100000:1.0:1788869541.201766:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869541.201777:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325093248 00000100:00100000:3.0:1788869541.201781:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325093248 00000100:00100000:1.0:1788869541.201793:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788869541.201795:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788869541.201799:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325092608:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.201801:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325092736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.202397:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869541.205821:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325092736:12345-0@lo:400:kworker.0 Request processed in 4006us (4496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.205839:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788869541.205888:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788869541.205904:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325093248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.205978:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325093248:12345-0@lo:400:kworker.0 Request processed in 83us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.205985:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:3.0:1788869541.206015:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869541.206221:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325092352:0@lo:400:kworker.0 00010000:00080000:3.0:1788869541.206242:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27041ead80 x1875765325092864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869541.206255:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325092864:0@lo:400:kworker.0 00010000:00080000:3.0:1788869541.206268:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27041e9880 x1875765325093376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869541.206278:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325093376:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.206293:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325092480:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.206308:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325092992:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.206349:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325093504:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.206411:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325092608 00000100:00100000:3.0:1788869541.206419:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325092608 00000100:00100000:3.0:1788869541.206464:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788869541.206471:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325092608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.209504:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325093120:0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.209581:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869541.209683:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325092608:12345-0@lo:400:kworker.0 Request processed in 3210us (7286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869541.209695:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788869541.210257:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325093632:0@lo:400:kworker.0 00000100:00100000:0.0:1788869541.210715:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3648:1875765325092096:0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.211419:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869541.215083:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325092736:0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.215121:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325093248:0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.215159:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325092608:0@lo:400:kworker.0 00000100:00100000:3.0:1788869541.216366:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325093120 00000100:00100000:3.0:1788869541.216379:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325093120 00000100:00080000:0.0:1788869541.216560:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869541.221195:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325093632 00000100:00100000:2.0:1788869541.221215:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325093632 00000100:00100000:2.0:1788869541.221336:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788869541.221348:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325093120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869541.221467:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325093120:12345-0@lo:400:kworker.0 Request processed in 123us (11886us total) trans 0 rc 0/0 00000100:00080000:0.0:1788869541.221526:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869541.221678:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325093120:0@lo:400:kworker.0 00000100:00100000:2.0:1788869541.222073:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788869541.222303:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788869541.222328:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325093632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869541.222395:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325093632:12345-0@lo:400:kworker.0 Request processed in 84us (10979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869541.222402:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788869541.222528:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788869541.222534:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1788869541.222553:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e270417f100, transno 4294967302 00000004:00080000:0.0:1788869541.222572:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788869541.222602:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e282f0bd500, transno 4294967305 00000100:00100000:0.0:1788869541.222608:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325093632:0@lo:400:kworker.0 00000100:00100000:0.0:1788869541.701940:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325093760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869541.702012:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869541.702486:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325093760 00000100:00100000:3.0:1788869541.702497:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325093760 00000100:00100000:3.0:1788869541.702561:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788869541.702570:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325093760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869541.702645:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869541.702697:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325093760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.702705:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788869541.702841:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325093760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869541.704125:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325093888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869541.704189:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869541.704300:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325093888 00000100:00100000:1.0:1788869541.704316:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325093888 00000100:00100000:1.0:1788869541.704369:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788869541.704378:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325093888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869541.704406:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869541.704460:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325093888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869541.704468:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788869541.704824:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325093888:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788869542.086939:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869542.087663:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869542.855131:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869542.855142:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869542.855172:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788869542.855181:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788869543.110127:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869543.240286:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869543.240312:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325094016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869543.240382:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869543.240724:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325094016 00000100:00100000:3.0:1788869543.240734:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325094016 00000100:00100000:3.0:1788869543.240797:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788869543.240807:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325094016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869543.240849:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788869543.240908:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325094016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869543.240915:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788869543.241140:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325094016:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788869543.243551:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788869543.243565:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1788869543.245730:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1788869543.245770:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e282f0ca780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788869543.245777:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2841118100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e282f0cac00 00000020:00080000:2.0:1788869543.245793:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2841118d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2703bcb400 00000020:00080000:2.0:1788869543.245837:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788869543.246016:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788869543.246097:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788869543.246399:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869543.246441:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869543.246450:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869543.246456:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869543.246461:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869543.246477:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869543.246495:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e270365c100) 00010000:00010000:0.0:1788869543.246498:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869543.246503:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869543.246508:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf1f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869544.136102:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869544.261846:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869544.261871:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325094272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869544.261949:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869544.262022:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325094144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869544.262036:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325094272 00000100:00100000:3.0:1788869544.262045:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325094272 00000100:00100000:2.0:1788869544.262045:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869544.262090:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325094144 00000100:00100000:2.0:1788869544.262094:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325094144 00000100:00100000:3.0:1788869544.262103:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788869544.262112:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325094272:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869544.262115:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788869544.262119:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325094144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869544.262142:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00002000:00000024:2.0:1788869544.262142:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788869544.262188:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325094272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869544.262195:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1788869544.262214:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869544.262312:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325094144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869544.262318:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788869544.262358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325094272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869544.262367:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788869544.262371:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2704201180, transno 4294967311 00000004:00080000:2.0:1788869544.262424:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1788869544.262448:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325094144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869545.158149:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869545.286935:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869545.286964:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325094400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869545.287047:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869545.287195:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325094400 00000100:00100000:3.0:1788869545.287204:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325094400 00000100:00100000:3.0:1788869545.287269:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788869545.287279:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325094400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869545.287320:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869545.287382:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325094400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869545.287389:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788869545.287616:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325094400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869545.404985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869545.405037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869545.405076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869545.405114:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869545.405134:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869545.405155:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869545.405180:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869545.405353:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305089408 00000100:00100000:3.0:1788869545.405364:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305089408 00000100:00100000:3.0:1788869545.405429:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305089920 00000100:00100000:3.0:1788869545.405432:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305089920 00000100:00100000:3.0:1788869545.405447:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305089536 00000100:00100000:3.0:1788869545.405450:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305089536 00000100:00100000:3.0:1788869545.405462:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305090048 00000100:00100000:3.0:1788869545.405465:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305090048 00000100:00100000:3.0:1788869545.405485:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 343 00000100:00100000:3.0:1788869545.405496:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:2410:x1875765305089408:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869545.405662:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:2410:x1875765305089408:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 157us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869545.405671:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 343 00000100:00100000:3.0:1788869545.405692:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 344 00000100:00100000:3.0:1788869545.405699:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305089920:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869545.405725:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305089920:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869545.405730:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 344 00000100:00100000:3.0:1788869545.405743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 345 00000100:00100000:3.0:1788869545.405749:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305089536:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869545.405773:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305089536:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869545.405778:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 345 00000100:00100000:3.0:1788869545.405789:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 346 00000100:00100000:3.0:1788869545.405808:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305090048:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869545.405833:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305090048:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 38us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869545.405839:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 346 00000100:00100000:1.0:1788869545.406220:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305089664 00000100:00100000:1.0:1788869545.406226:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305089664 00000100:00100000:1.0:1788869545.406285:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305089792 00000100:00100000:1.0:1788869545.406289:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305089792 00000100:00100000:1.0:1788869545.406314:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:1.0:1788869545.406333:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305089664:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869545.406366:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305089664:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869545.406371:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:1.0:1788869545.406400:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:1.0:1788869545.406406:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305089792:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869545.406428:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305089792:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869545.406434:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:2.0:1788869545.406643:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305089280 00000100:00100000:2.0:1788869545.406648:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305089280 00000100:00100000:2.0:1788869545.406687:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 394 00000100:00100000:2.0:1788869545.406693:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305089280:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869545.406723:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305089280:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869545.406728:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 394 00000100:00080000:0.0:1788869545.407854:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869545.407862:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869545.407866:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869545.407870:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869546.184119:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869546.323943:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325094528:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.324028:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869546.324835:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325094528 00000100:00100000:2.0:1788869546.324846:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325094528 00000100:00100000:1.0:1788869546.326898:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325094656:0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.326994:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869546.328556:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325094656 00000100:00100000:3.0:1788869546.328572:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325094656 00000100:00100000:3.0:1788869546.328689:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788869546.328702:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325094656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.328892:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325094656:12345-0@lo:400:kworker.0 Request processed in 193us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869546.328901:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788869546.328978:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325094656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869546.329925:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788869546.329941:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325094528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869546.330014:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325094528:12345-0@lo:400:kworker.0 Request processed in 80us (5986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869546.330036:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788869546.330851:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325094528:0@lo:400:kworker.0 00000100:00100000:2.0:1788869546.338651:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325094784:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.338696:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325094912:0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.338793:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325095168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.353855:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325095040:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.353941:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869546.362915:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869546.362969:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325095168 00000100:00100000:1.0:1788869546.362979:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325095168 00000100:00100000:1.0:1788869546.363042:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788869546.363053:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325095168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.363123:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325095168:12345-0@lo:400:kworker.0 Request processed in 72us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869546.363130:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:1.0:1788869546.363167:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869546.363203:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325095168:0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.363246:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325095680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.363301:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869546.363323:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325095680 00000100:00100000:1.0:1788869546.363327:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325095680 00000100:00100000:1.0:1788869546.363357:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788869546.363365:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325095680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.363810:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325095680:12345-0@lo:400:kworker.0 Request processed in 445us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869546.363819:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:1.0:1788869546.363843:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869546.363864:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325095680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.363881:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788869546.363889:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325095296:0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.363915:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869546.363937:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325095296 00000100:00100000:1.0:1788869546.363941:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325095296 00000100:00100000:1.0:1788869546.363967:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788869546.363974:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325095296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.364006:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325095296:12345-0@lo:400:kworker.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869546.364012:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:1.0:1788869546.364027:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788869546.364045:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283f47d500 x1875765325095296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869546.364056:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325095296:0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.364062:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325095808:0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.364098:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869546.364116:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325095808 00000100:00100000:1.0:1788869546.364119:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325095808 00000100:00100000:1.0:1788869546.364146:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788869546.364152:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325095808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869546.364183:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325095808:12345-0@lo:400:kworker.0 Request processed in 32us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869546.364189:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:1.0:1788869546.364205:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788869546.364219:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27042aea00 x1875765325095808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869546.364229:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325095808:0@lo:400:kworker.0 00000100:00100000:0.0:1788869546.367022:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325095040 00000100:00100000:0.0:1788869546.367036:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325095040 00000100:00100000:0.0:1788869546.367099:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788869546.367111:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325095040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869546.367212:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325095040:12345-0@lo:400:kworker.0 Request processed in 103us (13271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869546.367220:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788869546.367249:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869546.369947:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325094784 00000100:00100000:1.0:1788869546.369972:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325094784 00000100:00100000:0.0:1788869546.370666:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788869546.370682:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325094784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869546.370865:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325094784:12345-0@lo:400:kworker.0 Request processed in 188us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869546.370873:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788869546.370965:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325094784:0@lo:400:kworker.0 00000100:00100000:2.0:1788869546.371126:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869546.371213:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325094912 00000100:00100000:0.0:1788869546.371220:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325094912 00000100:00100000:0.0:1788869546.371256:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788869546.371263:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325094912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.371953:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325095040:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.371971:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325095552:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.372019:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869546.372080:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325096064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.372108:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869546.372192:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325094912:12345-0@lo:400:kworker.0 Request processed in 927us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869546.372201:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788869546.372203:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788869546.372209:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325095424:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.372233:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869546.372255:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325095552 00000100:00100000:0.0:1788869546.372259:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325095552 00000100:00100000:0.0:1788869546.372302:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325096064 00000100:00100000:0.0:1788869546.372305:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325096064 00000100:00100000:0.0:1788869546.372325:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788869546.372332:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325095552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869546.372381:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325095552:12345-0@lo:400:kworker.0 Request processed in 50us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869546.372511:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788869546.372525:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788869546.372532:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325096064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869546.372562:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325096064:12345-0@lo:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869546.372567:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788869546.372691:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325095936:0@lo:400:kworker.0 00000100:00080000:1.0:1788869546.372701:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869546.372705:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869546.372716:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869546.372927:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325095552:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.372937:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325096064:0@lo:400:kworker.0 00000100:00100000:0.0:1788869546.372990:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325095424 00000100:00100000:0.0:1788869546.372995:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325095424 00000100:00100000:0.0:1788869546.373021:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325095936 00000100:00100000:0.0:1788869546.373023:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325095936 00000100:00100000:0.0:1788869546.373034:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788869546.373040:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325095424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869546.373278:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325095424:12345-0@lo:400:kworker.0 Request processed in 237us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869546.373285:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788869546.373299:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788869546.373305:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325095936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869546.373333:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325095936:12345-0@lo:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869546.373339:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788869546.379787:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325094912:0@lo:400:kworker.0 00000100:00080000:1.0:1788869546.382291:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869546.382302:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869546.387500:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325095424:0@lo:400:kworker.0 00000100:00100000:3.0:1788869546.387538:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325095936:0@lo:400:kworker.0 00000100:00100000:2.0:1788869546.821861:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869546.821887:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325096192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869546.821971:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869546.822092:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325096192 00000100:00100000:0.0:1788869546.822102:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325096192 00000100:00100000:0.0:1788869546.822167:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788869546.822178:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325096192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869546.822236:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869546.822303:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325096192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869546.822310:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788869546.822400:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325096192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869546.822882:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869546.822920:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869546.823092:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325096320 00000100:00100000:3.0:1788869546.823099:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325096320 00000100:00100000:3.0:1788869546.823143:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788869546.823152:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325096320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869546.823167:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869546.823213:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325096320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869546.823220:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788869546.823293:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869546.891708:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869546.891852:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305090176 00000100:00100000:1.0:1788869546.891863:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305090176 00000100:00100000:1.0:1788869546.891925:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:1.0:1788869546.891935:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11106:x1875765305090176:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788869546.892060:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11106:x1875765305090176:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 126us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869546.892086:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:2.0:1788869546.905578:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869546.905842:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305090304 00000100:00100000:1.0:1788869546.905855:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305090304 00000100:00100000:1.0:1788869546.905934:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:1.0:1788869546.905946:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:11106:x1875765305090304:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788869546.906097:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:11106:x1875765305090304:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 153us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869546.906105:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:2.0:1788869546.908980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869546.909075:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305090560 00000100:00100000:0.0:1788869546.909089:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305090560 00000100:00100000:0.0:1788869546.909157:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788869546.909167:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:11106:x1875765305090560:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869546.909450:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:11106:x1875765305090560:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 284us (480us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788869546.909457:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00010000:00010000:1.0:1788869547.209346:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869548.229984:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869548.358461:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869548.358485:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325096448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869548.358576:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869548.358788:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325096448 00000100:00100000:0.0:1788869548.358799:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325096448 00000100:00100000:0.0:1788869548.358857:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788869548.358867:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2808315450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325096448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869548.358907:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788869548.358975:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2808315450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325096448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869548.358984:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788869548.359030:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325096448:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788869548.873080:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:3.0:1788869548.873103:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788869548.873159:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788869548.873173:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788869549.266733:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869549.331368:0:14517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:12:26 (1788869546) 00000100:00100000:0.0:1788869549.384549:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869549.384624:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325096576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869549.384706:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869549.384795:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325096576 00000100:00100000:0.0:1788869549.384805:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325096576 00000100:00100000:0.0:1788869549.384896:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788869549.384906:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325096576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869549.384941:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788869549.385007:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325096576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869549.385015:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1788869549.385047:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869549.385102:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325096576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869549.385149:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869549.385160:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325096704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869549.385189:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869549.385504:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325096704 00000100:00100000:3.0:1788869549.385511:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325096704 00000100:00100000:3.0:1788869549.385567:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788869549.385606:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325096704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869549.385619:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788869549.385672:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325096704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869549.385679:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788869549.385712:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325096704:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788869549.386097:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788869550.277961:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869550.405911:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325096832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869550.406054:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869550.406242:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325096832 00000100:00100000:0.0:1788869550.406256:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325096832 00000100:00100000:0.0:1788869550.406324:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788869550.406337:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325096832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869550.406381:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869550.406442:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325096832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869550.406449:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788869550.406520:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325096832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869550.525355:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869550.525741:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869550.525852:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869550.525886:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869550.525968:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305091200 00000100:00100000:3.0:1788869550.525982:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305091200 00000100:00100000:1.0:1788869550.527181:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305090688 00000100:00100000:1.0:1788869550.527194:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305090688 00000100:00100000:1.0:1788869550.527300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 396 00000100:00100000:1.0:1788869550.527312:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305090688:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869550.528702:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305090688:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1379us (3468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869550.528719:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 396 00000100:00100000:3.0:1788869550.529329:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:3.0:1788869550.529344:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305091200:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869550.529434:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305091200:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 96us (3582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869550.529442:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00080000:1.0:1788869550.529945:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869550.533185:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305090944 00000100:00100000:2.0:1788869550.533209:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305090944 00000100:00080000:1.0:1788869550.533825:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869550.533921:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869550.536092:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305091456 00000100:00100000:3.0:1788869550.536116:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305091456 00000100:00100000:3.0:1788869550.536224:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305090816 00000100:00100000:3.0:1788869550.536228:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305090816 00000100:00100000:1.0:1788869550.536802:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 353 00000100:00100000:1.0:1788869550.536860:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305090944:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869550.536861:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 354 00000100:00100000:3.0:1788869550.536868:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305091456:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869550.536937:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 355 00000100:00100000:2.0:1788869550.536949:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:2410:x1875765305090816:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869550.537662:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305091456:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 789us (11770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869550.537678:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 354 00000100:00080000:3.0:1788869550.537733:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869550.537739:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869550.537835:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869550.537878:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305091072 00000100:00100000:0.0:1788869550.537885:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305091072 00000100:00100000:0.0:1788869550.537935:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:0.0:1788869550.537943:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305091072:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869550.537985:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305091072:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869550.537992:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:1.0:1788869550.538185:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305090944:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1330us (12443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869550.538212:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 353 00000100:00080000:3.0:1788869550.538259:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869550.538479:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:2410:x1875765305090816:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1531us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.538488:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 355 00000100:00100000:0.0:1788869550.539013:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869550.539203:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305091328 00000100:00100000:3.0:1788869550.539211:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305091328 00000100:00080000:0.0:1788869550.539476:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869550.539861:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 356 00000100:00100000:2.0:1788869550.539892:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305091328:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869550.539983:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305091328:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 95us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.539990:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 356 00000100:00100000:3.0:1788869551.279028:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869551.280468:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305091712 00000100:00100000:1.0:1788869551.280491:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305091712 00000100:00100000:1.0:1788869551.280620:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:1.0:1788869551.280636:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:12170:x1875765305091712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869551.280776:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869551.280812:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf283 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f6a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.281038:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.281058:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.281211:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.289709:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.289741:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.289758:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.289902:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf298 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.289934:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf298 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.289942:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf298 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869551.289956:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788869551.290073:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290080:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290088:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290094:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869551.290099:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290107:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290121:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2803b9b000) 00010000:00010000:1.0:1788869551.290125:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869551.290132:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290139:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf28a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290156:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290169:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290175:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290180:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869551.290183:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290190:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290198:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e2701ece200) 00010000:00010000:1.0:1788869551.290201:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869551.290204:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.290210:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf291 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.292017:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf283 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f6a expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.292044:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf298 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f6a expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869551.292053:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:1.0:1788869551.292056:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869551.292067:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ea00, rc 0) 00000100:00100000:1.0:1788869551.293246:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:12170:x1875765305091712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 12607us (14228us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788869551.293257:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 149 00010000:00010000:0.0:1788869551.302756:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869551.311105:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869551.311179:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869551.311298:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305091968 00000100:00100000:2.0:1788869551.311320:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305091968 00000100:00100000:2.0:1788869551.311420:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1788869551.311432:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:2408:x1875765305091968:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869551.311467:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869551.311504:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf298 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f6a expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869551.311547:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:2.0:1788869551.311555:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869551.311683:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:2408:x1875765305091968:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 252us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869551.311692:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788869551.313422:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305091840 00000100:00100000:0.0:1788869551.313443:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305091840 00000100:00100000:0.0:1788869551.313545:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:0.0:1788869551.313560:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:12170:x1875765305091840:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788869551.313985:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:12170:x1875765305091840:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 206us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869551.313996:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:0.0:1788869551.335036:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869551.335340:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305092096 00000100:00100000:2.0:1788869551.335356:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305092096 00000100:00100000:2.0:1788869551.335464:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:2.0:1788869551.335477:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:12170:x1875765305092096:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788869551.335840:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:12170:x1875765305092096:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 363us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869551.335850:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:1.0:1788869551.431013:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325097216:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431090:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431169:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325097728:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431199:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431226:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325098240:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431251:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431277:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869551.431283:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325097344:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431305:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431323:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325097856:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431352:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431371:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325098368:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431394:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431427:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325097216 00000100:00100000:1.0:1788869551.431436:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325097216 00000100:00100000:1.0:1788869551.431487:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788869551.431497:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325097216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431573:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325097216:12345-0@lo:400:kworker.0 Request processed in 77us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869551.431580:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788869551.431662:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325097088:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.431696:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869551.431716:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325097600:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.431737:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869551.431753:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325098112:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.431770:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431788:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325097728 00000100:00100000:3.0:1788869551.431793:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788869551.431793:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325097728 00000100:00100000:3.0:1788869551.431799:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325096960:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431821:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325098240 00000100:00100000:1.0:1788869551.431824:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325098240 00000100:00100000:3.0:1788869551.431827:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431838:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325097344 00000100:00100000:1.0:1788869551.431840:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325097344 00000100:00100000:3.0:1788869551.431849:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325097472:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431851:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325097088 00000100:00100000:1.0:1788869551.431853:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325097088 00000100:00100000:1.0:1788869551.431863:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325097600 00000100:00100000:1.0:1788869551.431865:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325097600 00000100:00100000:3.0:1788869551.431871:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431877:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325098112 00000100:00100000:1.0:1788869551.431880:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325098112 00000100:00100000:3.0:1788869551.431886:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325097984:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431894:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788869551.431900:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325097728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.431906:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869551.431923:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325098496:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.431931:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325097728:12345-0@lo:400:kworker.0 Request processed in 32us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869551.431938:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788869551.431941:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869551.431954:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788869551.431959:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325098240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.431968:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325097856 00000100:00100000:3.0:1788869551.431972:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325097856 00000100:00100000:1.0:1788869551.431985:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325098240:12345-0@lo:400:kworker.0 Request processed in 27us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869551.431991:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788869551.432000:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325098368 00000100:00100000:3.0:1788869551.432003:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325098368 00000100:00100000:1.0:1788869551.432004:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788869551.432008:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325097344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.432017:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325097984 00000100:00100000:3.0:1788869551.432019:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325097984 00000100:00100000:3.0:1788869551.432031:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325098496 00000100:00100000:3.0:1788869551.432034:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325098496 00000100:00100000:1.0:1788869551.432034:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325097344:12345-0@lo:400:kworker.0 Request processed in 25us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869551.432040:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788869551.432046:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788869551.432052:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325097856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.432052:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788869551.432057:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325097088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.432082:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325097856:12345-0@lo:400:kworker.0 Request processed in 30us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869551.432088:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788869551.432090:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325097088:12345-0@lo:400:kworker.0 Request processed in 33us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869551.432096:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788869551.432100:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788869551.432105:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325098368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.432108:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788869551.432131:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325098368:12345-0@lo:400:kworker.0 Request processed in 26us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869551.432137:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788869551.432155:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788869551.432161:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325097984:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788869551.432223:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869551.432228:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869551.432231:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869551.432233:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869551.432289:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325097600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.432320:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325097600:12345-0@lo:400:kworker.0 Request processed in 35us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869551.433258:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325097984:12345-0@lo:400:kworker.0 Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869551.433281:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788869551.433307:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788869551.433319:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325098496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434231:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325098496:12345-0@lo:400:kworker.0 Request processed in 912us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869551.434242:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788869551.434285:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325096960 00000100:00100000:3.0:1788869551.434293:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325096960 00000100:00100000:3.0:1788869551.434338:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788869551.434345:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325096960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434558:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325096960:12345-0@lo:400:kworker.0 Request processed in 213us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869551.434565:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788869551.434616:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325097472 00000100:00100000:3.0:1788869551.434621:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325097472 00000100:00100000:3.0:1788869551.434651:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788869551.434658:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325097472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434693:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325097472:12345-0@lo:400:kworker.0 Request processed in 37us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869551.434699:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788869551.434761:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325096960:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434776:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325097472:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434804:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325097984:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434815:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325098496:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434827:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325097088:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434837:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325097600:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434944:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325097344:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434957:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325097856:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434968:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325098368:0@lo:400:kworker.0 00000100:00100000:3.0:1788869551.434979:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325097216:0@lo:400:kworker.0 00010000:00080000:3.0:1788869551.434992:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2827a5c000 x1875765325097728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869551.435002:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325097728:0@lo:400:kworker.0 00010000:00080000:3.0:1788869551.435013:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703956680 x1875765325098240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869551.435021:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325098240:0@lo:400:kworker.0 00000100:00100000:0.0:1788869551.435261:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788869551.435274:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325098112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869551.435325:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325098112:12345-0@lo:400:kworker.0 Request processed in 56us (3553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869551.435341:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788869551.435394:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325098112:0@lo:400:kworker.0 00000100:00100000:1.0:1788869551.436231:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788869551.942799:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869551.942829:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325098624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869551.942908:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869551.942966:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869551.942975:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325098752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869551.943002:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869551.943030:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325098624 00000100:00100000:0.0:1788869551.943038:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325098624 00000100:00100000:0.0:1788869551.943082:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325098752 00000100:00100000:0.0:1788869551.943085:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325098752 00000100:00100000:0.0:1788869551.943116:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788869551.943125:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325098624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869551.943158:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869551.943203:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325098624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869551.943210:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788869551.943228:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788869551.943235:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325098752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869551.943244:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869551.943271:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325098752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869551.943276:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788869551.943328:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325098752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869551.943380:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325098624:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1788869552.069817:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869552.069833:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869552.069930:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788869552.069940:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788869552.326341:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788869552.327252:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869553.351789:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869553.478817:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325098880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869553.478910:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869553.479042:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325098880 00000100:00100000:3.0:1788869553.479056:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325098880 00000100:00100000:3.0:1788869553.479141:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788869553.479163:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325098880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869553.479216:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788869553.479288:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325098880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869553.479306:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788869553.479330:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325098880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869553.617984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869553.618097:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305092224 00000100:00100000:2.0:1788869553.618109:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305092224 00000100:00100000:2.0:1788869553.618181:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:2.0:1788869553.618192:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:12213:x1875765305092224:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869553.618213:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869553.618235:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f71 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618305:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618319:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618330:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618343:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618350:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618357:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618428:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618435:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618441:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618446:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869553.618449:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618456:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618467:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecd700) 00010000:00010000:2.0:1788869553.618471:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869553.618476:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.618482:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869553.618538:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788869553.625464:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.625484:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.625500:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.625514:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869553.625518:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.625526:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.625544:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e280839c100) 00010000:00010000:2.0:1788869553.625547:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869553.625552:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.625558:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.626322:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f71 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.626339:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecd700) 00010000:00010000:2.0:1788869553.626341:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869553.626346:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f71 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.626360:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb800, rc 0) 00000100:00100000:2.0:1788869553.626524:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:12213:x1875765305092224:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 8332us (8551us total) trans 0 rc 301/301 00000100:00100000:2.0:1788869553.626537:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:1.0:1788869553.635918:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869553.636017:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305092480 00000100:00100000:2.0:1788869553.636046:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305092480 00000100:00100000:2.0:1788869553.636126:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00100000:2.0:1788869553.636138:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+14:12213:x1875765305092480:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1788869553.636205:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869553.636236:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cec08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d9c expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.636259:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecd700) 00010000:00010000:2.0:1788869553.636289:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869553.636380:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.636398:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.636410:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.636424:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.636431:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.636438:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637223:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637238:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637253:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869553.637269:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000579ab614 reply state 00000000f2399ba4 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637279:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637286:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869553.637288:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869553.637291:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788869553.637297:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788869553.637304:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637311:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637317:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637323:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869553.637327:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637334:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637341:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:2.0:1788869553.637344:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869553.637353:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637359:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869553.637379:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000579ab614 reply state 00000000f2399ba4 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637387:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.637394:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e280839ce00) 00010000:00010000:2.0:1788869553.637396:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869553.637398:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788869553.637526:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:12213:x1875765305092480:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 1387us (1617us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788869553.637534:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00100000:0.0:1788869553.738697:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869553.738840:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305092608 00000100:00100000:2.0:1788869553.738857:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305092608 00000100:00100000:2.0:1788869553.738939:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:2.0:1788869553.738954:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+15:12221:x1875765305092608:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:2.0:1788869553.738999:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869553.739038:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f78 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.739200:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf2d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.739220:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.739259:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869553.739309:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869553.739312:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869553.739339:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.739367:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f78 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.739389:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f78 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.739399:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:2.0:1788869553.739403:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869553.739407:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda600, rc 0) 00000100:00100000:2.0:1788869553.739649:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:12221:x1875765305092608:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 698us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869553.739658:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:3.0:1788869553.828526:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869553.828962:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305092736 00000100:00100000:2.0:1788869553.828977:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305092736 00000100:00100000:2.0:1788869553.829062:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:2.0:1788869553.829086:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+16:12227:x1875765305092736:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869553.829125:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869553.829154:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f7f expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829262:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829284:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829299:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829311:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829319:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829326:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829431:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf2f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829440:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829448:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869553.829498:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788869553.829502:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869553.829525:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829552:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829559:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829566:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829573:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869553.829577:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829642:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829656:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:2.0:1788869553.829660:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869553.829666:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829672:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf2e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829690:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829697:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829703:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829715:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869553.829718:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829725:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829734:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e280839ce00) 00010000:00010000:2.0:1788869553.829736:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869553.829739:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829744:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf2ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829778:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf2de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f7f expref: 18 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829794:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f7f expref: 17 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.829803:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869553.829806:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788869553.829808:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda000, rc 0) 00000100:00100000:2.0:1788869553.829888:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:12227:x1875765305092736:12345-192.168.204.54@tcp:101:bash.0 Request processed in 806us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869553.829895:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:1.0:1788869553.834945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869553.834993:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305092992 00000100:00100000:2.0:1788869553.835027:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305092992 00000100:00100000:2.0:1788869553.835099:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:2.0:1788869553.835111:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+17:12227:x1875765305092992:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869553.835140:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869553.835168:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf2fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f86 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.835290:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.835307:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.835319:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.835370:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.835378:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.835385:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869553.835841:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788869553.835990:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836000:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836021:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836058:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836065:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836072:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836078:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869553.836083:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836091:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836105:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869553.836108:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869553.836114:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836120:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf301 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869553.836137:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f269506 reply state 0000000048e87273 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836150:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836164:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839c200) 00010000:00010000:2.0:1788869553.836167:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869553.836170:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788869553.836213:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf2fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f86 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836229:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f86 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869553.836237:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839c600) 00010000:00010000:2.0:1788869553.836240:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869553.836242:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7200, rc 0) 00000100:00100000:2.0:1788869553.836338:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12227:x1875765305092992:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1230us (1410us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788869553.836346:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:0.0:1788869553.839848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869553.840065:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305093120 00000100:00100000:3.0:1788869553.840088:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305093120 00000100:00100000:3.0:1788869553.840182:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:3.0:1788869553.840194:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305093120:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788869553.840215:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869553.840238:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f8d expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869553.840272:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869553.840298:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1788869553.840304:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869553.840314:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f8d expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869553.840340:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f8d expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869553.840357:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8000, rc 0) 00000100:00100000:3.0:1788869553.840448:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305093120:12345-192.168.204.54@tcp:101:bash.0 Request processed in 256us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869553.840454:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00080000:0.0:1788869553.840692:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869553.848247:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869553.848408:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305093248 00000100:00100000:0.0:1788869553.848423:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305093248 00000100:00100000:0.0:1788869553.848500:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1788869553.848513:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:12227:x1875765305093248:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869553.848533:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869553.848554:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f94 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869553.848627:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f8d expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869553.848637:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869553.848642:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869553.848649:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869553.848696:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f8d expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869553.848712:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f8d expref: 7 pid: 8440 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869553.848747:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1875765325099008:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869553.848863:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869553.852814:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1875765325099008:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869553.852868:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869553.852881:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:0.0:1788869553.852894:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8200, rc 0) 00000100:00100000:0.0:1788869553.852980:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:12227:x1875765305093248:12345-192.168.204.54@tcp:101:bash.0 Request processed in 4468us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869553.852990:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788869553.853354:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305093376 00000100:00100000:1.0:1788869553.853364:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305093376 00010000:00010000:1.0:1788869553.853406:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f8d expref: 7 pid: 8440 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869553.853438:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1788869553.853448:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305093376:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869553.853465:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869553.853502:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f8d expref: 7 pid: 8440 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.853516:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f8d expref: 7 pid: 8440 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.853565:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ef13aae/0x4c16c38a9b6cf31d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f8d expref: 7 pid: 8440 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.853580:0:10401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869553.853620:0:10401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869553.853630:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 6 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.853641:0:10401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 6 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.853682:0:10401:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 6 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869553.853701:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10401:1875765325099136:192.168.204.54@tcp:105: 00000100:00100000:1.0:1788869553.853761:0:10401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869553.864778:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10401:1875765325099136:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788869553.864820:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869553.864898:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305093376:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 11450us (12015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869553.864911:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:2.0:1788869553.873047:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869553.873186:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305093632 00000100:00100000:1.0:1788869553.873202:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305093632 00000100:00100000:1.0:1788869553.873273:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788869553.873285:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12227:x1875765305093632:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:1.0:1788869553.873682:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:12227:x1875765305093632:12345-192.168.204.54@tcp:35:bash.0 Request processed in 398us (647us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788869553.873690:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1788869553.976886:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869553.977016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305093888 00000100:00100000:1.0:1788869553.977033:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305093888 00000100:00100000:1.0:1788869553.977114:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:1.0:1788869553.977127:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:12237:x1875765305093888:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869553.977157:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869553.977177:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf32b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9f9b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869553.977288:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788869553.977381:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf32b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f9b expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.977395:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:1.0:1788869553.977398:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869553.977402:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf32b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f9b expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.977418:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f000, rc 0) 00000100:00100000:1.0:1788869553.977498:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:12237:x1875765305093888:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 374us (624us total) trans 4294967422 rc 301/301 00000100:00100000:1.0:1788869553.977506:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:3.0:1788869553.985498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869553.985721:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305094144 00000100:00100000:1.0:1788869553.985738:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305094144 00000100:00100000:1.0:1788869553.985816:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:1.0:1788869553.985830:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:12237:x1875765305094144:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869553.986124:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:12237:x1875765305094144:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 297us (650us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788869553.986134:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:3.0:1788869554.053158:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869554.053304:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305094272 00000100:00100000:2.0:1788869554.053319:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305094272 00000100:00100000:2.0:1788869554.053386:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 158 00000100:00100000:2.0:1788869554.053407:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:12243:x1875765305094272:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869554.053440:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869554.053465:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf339 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fa2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.053561:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf340 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.053644:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf340 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.053659:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf340 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869554.053710:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788869554.053713:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869554.053738:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf340 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.053770:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf339 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fa2 expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.053795:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf340 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fa2 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.053804:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869554.053807:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869554.053811:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6400, rc 0) 00000100:00100000:2.0:1788869554.053895:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:12243:x1875765305094272:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 491us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.053902:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 158 00000100:00100000:3.0:1788869554.061128:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869554.063669:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305094528 00000100:00100000:1.0:1788869554.063691:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305094528 00000100:00100000:1.0:1788869554.063866:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:1.0:1788869554.063882:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:12243:x1875765305094528:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869554.063908:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869554.063937:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf347 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fa9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.064101:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf34e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.064119:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf34e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.064134:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf34e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869554.064146:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788869554.064287:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf347 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fa9 expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.064311:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf34e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fa9 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.064320:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839c600) 00010000:00010000:1.0:1788869554.064323:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869554.064326:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ea00, rc 0) 00000100:00100000:1.0:1788869554.064423:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+26:12243:x1875765305094528:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 545us (3306us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788869554.064452:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:3.0:1788869554.073154:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869554.073204:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869554.073327:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305094912 00000100:00100000:1.0:1788869554.073341:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305094912 00000100:00100000:1.0:1788869554.073443:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1788869554.073454:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703955500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+26:2409:x1875765305094912:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869554.073473:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869554.073516:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf34e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fa9 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.073542:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839c600) 00010000:00010000:1.0:1788869554.073547:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869554.073662:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703955500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:2409:x1875765305094912:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 209us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869554.073669:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788869554.074974:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305094784 00000100:00100000:2.0:1788869554.074990:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305094784 00000100:00100000:2.0:1788869554.075068:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:2.0:1788869554.075079:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:12243:x1875765305094784:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869554.075107:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869554.075153:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf35c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fb0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.075293:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf363 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.075313:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf363 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.075329:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf363 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869554.075344:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788869554.075496:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf35c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fb0 expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.075520:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf363 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fb0 expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.075529:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839c600) 00010000:00010000:2.0:1788869554.075532:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788869554.075536:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6200, rc 0) 00000100:00100000:2.0:1788869554.075651:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+27:12243:x1875765305094784:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 573us (2509us total) trans 4294967425 rc 0/0 00000100:00100000:2.0:1788869554.075658:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:3.0:1788869554.083138:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869554.083252:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305095040 00000100:00100000:0.0:1788869554.083267:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305095040 00000100:00100000:0.0:1788869554.083336:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:0.0:1788869554.083347:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305095040:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:0.0:1788869554.083404:0:11338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.083435:0:11338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 6 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.083469:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869554.083475:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869554.083492:0:11338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.083533:0:11338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 6 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.083551:0:11338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 6 pid: 8443 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869554.083571:0:11338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11338:1875765325099264:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869554.083719:0:11338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869554.089538:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869554.089890:0:11338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11338:1875765325099264:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869554.089925:0:11338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869554.090610:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305095168 00000100:00100000:2.0:1788869554.090623:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305095168 00002000:00100000:3.0:1788869554.093229:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8e283f47ea00 x1875765305095168/t0(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:500/0 lens 504/0 e 0 to 0 dl 1788869565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869554.093244:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e283f47ea00 with x1875765305095168 ext(0->12) 00010000:00010000:3.0:1788869554.093256:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 7 pid: 8443 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.093278:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 7 pid: 8443 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869554.093286:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e283f47ea00 00000100:00100000:3.0:1788869554.093404:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788869554.093540:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305095168:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:3.0:1788869554.095368:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2410:x1875765305095168:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 1823us (5838us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788869554.095382:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:3.0:1788869554.095403:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8e283f47ea00 x1875765305095168/t4294967306(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:500/0 lens 504/448 e 0 to 0 dl 1788869565 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869554.095413:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e283f47ea00 with x1875765305095168 ext(0->12) 00010000:00010000:3.0:1788869554.095436:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 9 pid: 8443 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.095452:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 9 pid: 8443 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869554.095460:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e283f47ea00 00000100:00100000:3.0:1788869554.101561:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869554.101892:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305095296 00000100:00100000:0.0:1788869554.101903:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305095296 00010000:00010000:0.0:1788869554.101949:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 9 pid: 8443 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869554.101998:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:0.0:1788869554.102009:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2407:x1875765305095296:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869554.102042:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788869554.102076:0:6511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788869554.102079:0:6511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788869552 00002000:00010000:0.0:1788869554.102081:0:6511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788869552 00002000:00010000:0.0:1788869554.102083:0:6511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788869552 00002000:00010000:0.0:1788869554.102085:0:6511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788869554.102092:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 9 pid: 8443 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.102107:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 9 pid: 8443 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.102140:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e4028ee/0x4c16c38a9b6cf324 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f94 expref: 9 pid: 8443 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.102160:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788869554.102165:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1788869554.102173:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.102185:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.102224:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869554.102297:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2407:x1875765305095296:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 289us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.102305:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00010000:00010000:3.0:1788869554.102836:0:11338:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.102847:0:11338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.102871:0:11338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.102880:0:11338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.102889:0:11338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.102897:0:11338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869554.102902:0:11338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.102923:0:11338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.102937:0:11338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.102944:0:11338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b225a37a/0x4c16c38a9b6cf371 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869554.103005:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2407:x1875765305095040:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 19660us (19880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869554.103013:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788869554.112505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869554.112668:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305095552 00000100:00100000:1.0:1788869554.112679:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305095552 00000100:00100000:1.0:1788869554.112734:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1788869554.112744:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28268b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+27:12243:x1875765305095552:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:1.0:1788869554.112819:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf363 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fb0 expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869554.113107:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788869554.113141:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1788869554.113468:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:1.0:1788869554.113522:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.113554:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f86 expref: 31 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.113564:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.113635:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f86 expref: 31 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.113650:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f86 expref: 31 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869554.113667:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875765325099392:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869554.113784:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869554.124265:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875765325099392:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869554.124307:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869554.125040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869554.126360:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305095680 00000100:00100000:2.0:1788869554.126381:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305095680 00010000:00010000:2.0:1788869554.126632:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f86 expref: 32 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869554.126702:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1788869554.126713:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+32:2409:x1875765305095680:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869554.126730:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869554.126738:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f86 expref: 32 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.126752:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f86 expref: 32 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.126778:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf30f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f86 expref: 32 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.126800:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839c600) 00010000:00010000:2.0:1788869554.126805:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.126815:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.126822:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.126848:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869554.126996:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.127006:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869554.127161:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:0.0:1788869554.127369:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788869554.127525:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ac000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875765325099520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788869554.127628:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869554.127661:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869554.128047:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:2409:x1875765305095680:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1332us (3007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.128068:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1788869554.128122:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325099520 00000100:00100000:2.0:1788869554.128142:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325099520 00000100:00100000:2.0:1788869554.128191:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788869554.128197:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1875765325099520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788869554.128284:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1875765325099520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.128290:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1788869554.128877:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869554.128920:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ac000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875765325099520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788869554.129090:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:0.0:1788869554.129161:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ac000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875765325099648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788869554.129207:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869554.129246:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869554.129453:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325099648 00000100:00100000:1.0:1788869554.129461:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325099648 00000100:00100000:1.0:1788869554.129511:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788869554.129519:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1875765325099648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788869554.129698:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1875765325099648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 179us (489us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788869554.129706:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788869554.130012:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ac000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875765325099648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788869554.130084:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788869554.130133:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.130145:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.130154:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.130161:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ea00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869554.130166:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.130199:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.130221:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839c600) 00010000:00010000:0.0:1788869554.130225:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788869554.130233:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.130240:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf378 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869554.130703:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788869554.130766:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788869554.130777:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 488044189693ns, next at 489044187412ns, rc = 0 00000001:00080000:0.0:1788869554.130784:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:0.0:1788869554.130810:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839c600) 00010000:00010000:0.0:1788869554.130813:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788869554.130819:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf363 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fb0 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869554.130930:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28268b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+34:12243:x1875765305095552:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 18187us (18448us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788869554.130937:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000020:00080000:0.0:1788869554.130942:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788869554.135041:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869554.135139:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305095808 00000100:00100000:2.0:1788869554.135155:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305095808 00000100:00100000:2.0:1788869554.135229:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:2.0:1788869554.135239:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+34:12243:x1875765305095808:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869554.135269:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869554.135298:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6600/0x4c16c38a9b6cf37f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fb7 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.135401:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6600/0x4c16c38a9b6cf37f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fb7 expref: 35 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.135430:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6600/0x4c16c38a9b6cf37f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fb7 expref: 35 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.135452:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:2.0:1788869554.135455:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869554.135459:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6600, rc 0) 00000100:00100000:2.0:1788869554.135535:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+35:12243:x1875765305095808:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 298us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.135542:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:3.0:1788869554.143341:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869554.143505:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305096064 00000100:00100000:1.0:1788869554.143534:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305096064 00000100:00100000:1.0:1788869554.143647:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788869554.143659:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+35:12243:x1875765305096064:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869554.143943:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:12243:x1875765305096064:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 285us (627us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788869554.143951:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1788869554.236880:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869554.236990:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305096320 00000100:00100000:2.0:1788869554.237018:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305096320 00000100:00100000:2.0:1788869554.237088:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:2.0:1788869554.237101:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:12253:x1875765305096320:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869554.237137:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869554.237163:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fbe expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869554.237270:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788869554.237368:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf386 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fbe expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.237382:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:2.0:1788869554.237522:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869554.237530:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fbe expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.237549:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7200, rc 0) 00000100:00100000:2.0:1788869554.237666:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+37:12253:x1875765305096320:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 568us (796us total) trans 4294967436 rc 301/301 00000100:00100000:2.0:1788869554.237674:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:1.0:1788869554.239898:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869554.239986:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305096448 00000100:00100000:2.0:1788869554.239998:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305096448 00000100:00100000:2.0:1788869554.240063:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:2.0:1788869554.240074:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+37:12253:x1875765305096448:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788869554.240218:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240235:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240260:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240273:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240280:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240287:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240538:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240547:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240555:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869554.240637:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240651:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240658:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240665:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240682:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869554.240687:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240695:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240710:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869554.240714:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869554.240719:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240727:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf394 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240743:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240750:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240756:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240761:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869554.240763:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240770:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240788:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839c200) 00010000:00010000:2.0:1788869554.240790:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869554.240794:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240800:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf39b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240811:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240817:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240822:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240828:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869554.240831:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240837:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240844:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:2.0:1788869554.240846:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869554.240849:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.240855:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869554.241065:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+37:12253:x1875765305096448:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 991us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.241074:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:3.0:1788869554.243238:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869554.243914:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305096704 00000100:00100000:1.0:1788869554.243925:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305096704 00000100:00100000:1.0:1788869554.244019:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1788869554.244031:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+37:12253:x1875765305096704:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869554.244916:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+38:12253:x1875765305096704:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 881us (1681us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788869554.244927:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788869554.279801:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869554.280058:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305096960 00000100:00100000:0.0:1788869554.280321:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305096960 00000100:00100000:0.0:1788869554.280614:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1788869554.280626:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+38:12256:x1875765305096960:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869554.280675:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869554.280700:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf3a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fc5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.280792:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.280810:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.280825:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.280838:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.280845:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.280852:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.280973:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.280983:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.280991:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869554.281002:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788869554.281105:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281123:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281129:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281135:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869554.281140:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281148:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281160:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869554.281163:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869554.281167:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281173:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf3b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281186:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281192:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281198:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281214:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869554.281217:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281224:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281233:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839c200) 00010000:00010000:0.0:1788869554.281235:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869554.281239:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281245:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281283:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf3a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fc5 expref: 41 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281301:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fc5 expref: 40 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.281309:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869554.281312:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869554.281314:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8a00, rc 0) 00000100:00100000:0.0:1788869554.281471:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:12256:x1875765305096960:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 846us (1686us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788869554.281488:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1788869554.285867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869554.285995:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305097088 00000100:00100000:1.0:1788869554.286005:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305097088 00000100:00100000:1.0:1788869554.286221:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:1.0:1788869554.286232:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:12256:x1875765305097088:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788869554.286312:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.286346:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.286359:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.286410:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.286427:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.286434:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.286441:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869554.286446:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.286454:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.286470:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869554.286473:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869554.286489:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.286496:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf3cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869554.286580:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:12256:x1875765305097088:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 349us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869554.286616:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:3.0:1788869554.292078:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869554.292209:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305097344 00000100:00100000:2.0:1788869554.292221:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305097344 00000100:00100000:2.0:1788869554.292282:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1788869554.292294:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:12256:x1875765305097344:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869554.292651:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+41:12256:x1875765305097344:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 359us (585us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788869554.292660:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00010000:00010000:0.0:1788869554.374720:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869554.501873:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869554.501900:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325099776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869554.501980:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869554.502118:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325099776 00000100:00100000:3.0:1788869554.502127:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325099776 00000100:00100000:3.0:1788869554.502199:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788869554.502210:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325099776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869554.502238:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788869554.502284:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325099776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869554.502304:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788869554.502360:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869554.502395:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325099776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869554.502740:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325099904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869554.502773:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869554.503003:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325099904 00000100:00100000:1.0:1788869554.503008:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325099904 00000100:00100000:1.0:1788869554.503056:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788869554.503064:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325099904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869554.503077:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788869554.503127:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325099904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869554.503134:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869554.503241:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325099904:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869554.503297:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869554.557821:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869554.557944:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305097600 00000100:00100000:2.0:1788869554.557956:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305097600 00000100:00100000:2.0:1788869554.558027:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:2.0:1788869554.558037:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+41:12287:x1875765305097600:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788869554.558078:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869554.558107:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fcc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.558245:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf3da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.558265:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf3da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.558277:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf3da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869554.558308:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788869554.558420:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fcc expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.558443:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf3da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fcc expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.558452:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:2.0:1788869554.558454:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869554.558458:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6200, rc 0) 00000100:00100000:2.0:1788869554.558531:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:12287:x1875765305097600:12345-192.168.204.54@tcp:101:cat.0 Request processed in 495us (723us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788869554.558538:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:0.0:1788869554.562687:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869554.562787:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305097856 00000100:00100000:2.0:1788869554.562796:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305097856 00000100:00100000:2.0:1788869554.562848:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1788869554.562857:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:12287:x1875765305097856:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1788869554.563119:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+44:12287:x1875765305097856:12345-192.168.204.54@tcp:35:cat.0 Request processed in 262us (440us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788869554.563127:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788869554.566335:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869554.566503:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305097984 00000100:00100000:0.0:1788869554.566514:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305097984 00000100:00100000:0.0:1788869554.566617:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788869554.566627:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+44:2407:x1875765305097984:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869554.566643:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869554.566671:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf3da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fcc expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.566696:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869554.566702:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869554.566759:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:2407:x1875765305097984:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 134us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.566766:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788869554.616012:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869554.616164:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305098240 00000100:00100000:2.0:1788869554.616174:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305098240 00000100:00100000:2.0:1788869554.616243:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1788869554.616254:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:12293:x1875765305098240:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1788869554.616281:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869554.616301:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788869554.616342:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf340 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fa2 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.616363:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869554.616367:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869554.616380:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fd3 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.616513:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.616528:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fc5 expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.616535:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.616573:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fc5 expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.616653:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fc5 expref: 43 pid: 6526 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869554.616670:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2704190380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325100032:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869554.619708:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703952d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869554.623360:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2704190380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325100032:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869554.623397:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869554.632347:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869554.635673:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305098368 00000100:00100000:1.0:1788869554.635690:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305098368 00010000:00010000:1.0:1788869554.635739:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fc5 expref: 44 pid: 6526 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869554.635790:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1788869554.635800:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+44:2407:x1875765305098368:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869554.635815:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869554.635823:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fc5 expref: 44 pid: 6526 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.635838:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fc5 expref: 44 pid: 6526 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.635863:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf3be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fc5 expref: 44 pid: 6526 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.635898:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869554.635903:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.635912:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.635920:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.635958:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869554.636534:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:2407:x1875765305098368:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 733us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869554.636543:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00010000:00010000:3.0:1788869554.636873:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.636883:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869554.636905:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788869554.637044:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf3e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fd3 expref: 44 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.637079:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fd3 expref: 43 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.637089:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869554.637091:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869554.637094:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7200, rc 0) 00000100:00100000:3.0:1788869554.637140:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:12293:x1875765305098240:12345-192.168.204.54@tcp:101:dd.0 Request processed in 20888us (21137us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788869554.637147:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1788869554.640291:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869554.640576:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305098496 00000100:00100000:0.0:1788869554.640706:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305098496 00000100:00100000:0.0:1788869554.640764:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:0.0:1788869554.640777:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:12293:x1875765305098496:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:0.0:1788869554.640803:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869554.640828:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fda expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.640866:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.640883:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.640911:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.641036:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf3fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fda expref: 45 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.641067:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fda expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.641077:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869554.641080:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869554.641084:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8200, rc 0) 00000100:00100000:0.0:1788869554.641462:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+44:12293:x1875765305098496:12345-192.168.204.54@tcp:101:dd.0 Request processed in 686us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.641481:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:2.0:1788869554.651140:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869554.651861:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305098752 00000100:00100000:1.0:1788869554.651876:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305098752 00000100:00100000:1.0:1788869554.651995:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:1.0:1788869554.652008:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+44:12293:x1875765305098752:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:1.0:1788869554.652306:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.652407:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.652422:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869554.652484:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788869554.652511:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076e2f744 reply state 000000002de7a656 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.652543:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.652567:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869554.652571:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869554.652576:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869554.652789:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+47:12293:x1875765305098752:12345-192.168.204.54@tcp:36:dd.0 Request processed in 783us (1659us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788869554.652798:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000020:00080000:1.0:1788869554.652804:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788869554.857883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869554.858000:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305098880 00000100:00100000:0.0:1788869554.858012:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305098880 00000100:00100000:0.0:1788869554.858094:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:0.0:1788869554.858105:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+47:12307:x1875765305098880:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:0.0:1788869554.858272:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869554.858296:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf412 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fe1 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858372:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858388:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858407:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858419:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858426:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858432:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858515:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858526:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fd3 expref: 48 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858536:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858673:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fd3 expref: 48 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.858688:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fd3 expref: 48 pid: 8260 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869554.858702:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325100160:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869554.858859:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869554.862086:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869554.862191:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305099136 00000100:00100000:3.0:1788869554.862201:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305099136 00000100:00100000:3.0:1788869554.862257:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1788869554.862267:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+49:6179:x1875765305099136:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788869554.862795:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325100160:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869554.862831:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869554.863899:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+50:6179:x1875765305099136:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 1626us (1816us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1788869554.863912:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1788869554.866175:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869554.866494:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305099264 00000100:00100000:3.0:1788869554.866508:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305099264 00010000:00010000:3.0:1788869554.866693:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fd3 expref: 50 pid: 8260 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869554.866790:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:3.0:1788869554.866801:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+50:2409:x1875765305099264:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869554.866820:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869554.866828:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fd3 expref: 50 pid: 8260 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.866842:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fd3 expref: 50 pid: 8260 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.866867:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf3ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fd3 expref: 50 pid: 8260 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.866887:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869554.866892:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.866921:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.866930:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.866965:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869554.867036:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+49:2409:x1875765305099264:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 236us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869554.867107:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00010000:00010000:0.0:1788869554.867414:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867424:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869554.867511:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788869554.867516:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869554.867545:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867572:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867582:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867613:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867619:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867626:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869554.867632:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867640:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867661:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869554.867664:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869554.867669:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867674:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf419 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867687:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867694:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867700:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867704:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869554.867707:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867713:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867720:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839c200) 00010000:00010000:0.0:1788869554.867723:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869554.867726:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867731:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf420 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867780:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf412 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe1 expref: 49 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867795:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe1 expref: 48 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.867802:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869554.867804:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869554.867807:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5800, rc 0) 00000100:00100000:0.0:1788869554.867851:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+48:12307:x1875765305098880:12345-192.168.204.54@tcp:101:stat.0 Request processed in 9747us (9979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.867858:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:2.0:1788869554.931530:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869554.931633:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305099520 00000100:00100000:3.0:1788869554.931645:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305099520 00000100:00100000:3.0:1788869554.931724:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:3.0:1788869554.931737:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+48:12313:x1875765305099520:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:3.0:1788869554.931809:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869554.931841:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf427 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe1 expref: 48 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.931864:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869554.931870:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869554.932086:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.932103:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.932114:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869554.932181:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:3.0:1788869554.932203:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000827cc7fc reply state 00000000249cf631 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.932216:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869554.932223:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869554.932226:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869554.932229:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869554.932322:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+50:12313:x1875765305099520:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 589us (808us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788869554.932330:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 171 00000020:00080000:3.0:1788869554.932335:0:8260:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788869555.081709:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869555.081836:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305099648 00000100:00100000:0.0:1788869555.081847:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305099648 00000100:00100000:0.0:1788869555.081926:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:0.0:1788869555.081940:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+50:12327:x1875765305099648:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:0.0:1788869555.081968:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869555.081990:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf435 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fe8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082073:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082088:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082101:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082127:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082135:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082142:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082221:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082231:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082238:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869555.082285:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788869555.082290:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869555.082312:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082326:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082336:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082342:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082361:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082368:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869555.082373:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082380:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082392:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869555.082396:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869555.082403:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082409:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf43c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082424:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082430:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082435:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082440:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869555.082443:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082457:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082477:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839c200) 00010000:00010000:0.0:1788869555.082479:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869555.082482:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082487:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf443 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082517:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf435 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe8 expref: 52 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082530:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe8 expref: 51 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.082537:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869555.082539:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869555.082542:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5200, rc 0) 00000100:00100000:0.0:1788869555.082664:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+51:12327:x1875765305099648:12345-192.168.204.54@tcp:101:stat.0 Request processed in 729us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.082672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00080000:1.0:1788869555.082819:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869555.167046:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869555.167295:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305099904 00000100:00100000:3.0:1788869555.167305:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305099904 00000100:00100000:3.0:1788869555.167376:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:3.0:1788869555.167386:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+51:12337:x1875765305099904:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869555.167410:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869555.167433:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9fef expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869555.167560:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788869555.168220:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf451 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fef expref: 53 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.168239:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:3.0:1788869555.168243:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869555.168268:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fef expref: 53 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.168285:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9600, rc 0) 00000100:00100000:3.0:1788869555.169341:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+52:12337:x1875765305099904:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1946us (2304us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1788869555.169353:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:2.0:1788869555.174108:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.174253:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305100160 00000100:00100000:1.0:1788869555.174267:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305100160 00000100:00100000:1.0:1788869555.174339:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1788869555.174348:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28268b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+52:12337:x1875765305100160:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869555.174869:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28268b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:12337:x1875765305100160:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 519us (774us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788869555.174877:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788869555.248832:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869555.248933:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305100416 00000100:00100000:0.0:1788869555.248944:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305100416 00000100:00100000:0.0:1788869555.249014:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:0.0:1788869555.249026:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:12343:x1875765305100416:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869555.249070:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869555.249091:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf45f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ff6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.249210:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.249226:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe8 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.249235:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.249269:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe8 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.249283:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe8 expref: 54 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869555.249298:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27042ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325100288:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869555.249416:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.255947:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869555.256045:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305100544 00000100:00100000:3.0:1788869555.256058:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305100544 00010000:00010000:3.0:1788869555.256110:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe8 expref: 55 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869555.256159:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1788869555.256171:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:2410:x1875765305100544:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869555.256190:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869555.256197:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe8 expref: 55 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.256212:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe8 expref: 55 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.256242:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869555.256248:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.256262:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.256271:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.256313:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869555.256379:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:2410:x1875765305100544:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 211us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.256387:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00010000:00010000:1.0:1788869555.257014:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf44a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fe8 expref: 54 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869555.257047:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27042ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325100288:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869555.257070:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.257080:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.257100:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869555.257121:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788869555.257278:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf45f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ff6 expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.257294:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ff6 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.257302:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869555.257305:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869555.257308:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4400, rc 0) 00000100:00100000:1.0:1788869555.257350:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+54:12343:x1875765305100416:12345-192.168.204.54@tcp:101:bash.0 Request processed in 8328us (8532us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788869555.257357:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:2.0:1788869555.263145:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.263252:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305100800 00000100:00100000:1.0:1788869555.263261:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305100800 00000100:00100000:1.0:1788869555.263317:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:1.0:1788869555.263327:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+54:12343:x1875765305100800:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:1.0:1788869555.265349:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.265374:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.265386:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869555.265504:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:1.0:1788869555.265553:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc9e8cf3 reply state 000000007203e616 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.265567:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.265575:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869555.265578:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869555.265582:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869555.265723:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:12343:x1875765305100800:12345-192.168.204.54@tcp:36:bash.0 Request processed in 2393us (2584us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788869555.265731:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 175 00000020:00080000:1.0:1788869555.265739:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788869555.274009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869555.274480:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305100928 00000100:00100000:2.0:1788869555.274495:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305100928 00000100:00100000:2.0:1788869555.274581:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:2.0:1788869555.274638:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:12343:x1875765305100928:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869555.274666:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869555.274691:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf47b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fc9ffd expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.274797:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.274814:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ff6 expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.274824:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.274866:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ff6 expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.274906:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ff6 expref: 58 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869555.274922:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325100416:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869555.275021:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703952f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.281078:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.281731:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305101056 00000100:00100000:1.0:1788869555.281744:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305101056 00010000:00010000:1.0:1788869555.281797:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ff6 expref: 59 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869555.281844:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:1.0:1788869555.281854:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:2409:x1875765305101056:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869555.281871:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869555.281878:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ff6 expref: 59 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.281893:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ff6 expref: 59 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.281959:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869555.281966:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.281977:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.281986:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.282009:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869555.282088:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:2409:x1875765305101056:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 234us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.282096:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00010000:00010000:0.0:1788869555.288816:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf466 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ff6 expref: 58 pid: 6524 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869555.288854:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325100416:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869555.288887:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.288939:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.288945:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869555.289041:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788869555.289046:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869555.289075:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.289123:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf47b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ffd expref: 58 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.289144:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ffd expref: 57 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.289154:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869555.289157:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869555.289162:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7200, rc 0) 00000100:00100000:0.0:1788869555.289466:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:12343:x1875765305100928:12345-192.168.204.54@tcp:101:bash.0 Request processed in 14820us (15459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.289476:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:2.0:1788869555.293687:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869555.294175:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305101312 00000100:00100000:3.0:1788869555.294187:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305101312 00000100:00100000:3.0:1788869555.294273:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788869555.294287:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:12343:x1875765305101312:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1788869555.294725:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:12343:x1875765305101312:12345-192.168.204.54@tcp:35:bash.0 Request processed in 438us (1053us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788869555.294734:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00010000:00010000:3.0:1788869555.399191:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869555.455442:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.458547:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305101568 00000100:00100000:1.0:1788869555.458699:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305101568 00000100:00100000:1.0:1788869555.458800:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:1.0:1788869555.458812:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+58:12353:x1875765305101568:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869555.459280:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869555.459308:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca004 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869555.459418:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788869555.459710:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf489 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca004 expref: 60 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.459726:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:1.0:1788869555.459749:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869555.459755:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca004 expref: 60 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.459784:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e600, rc 0) 00000100:00100000:1.0:1788869555.459918:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:12353:x1875765305101568:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1108us (4492us total) trans 4294967454 rc 301/301 00000100:00100000:1.0:1788869555.459926:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:2.0:1788869555.466941:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.467020:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305101696 00000100:00100000:1.0:1788869555.467030:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305101696 00000100:00100000:1.0:1788869555.467087:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:1.0:1788869555.467097:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:12353:x1875765305101696:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1788869555.467182:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467199:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467211:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467220:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467227:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467234:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467311:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467334:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467342:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869555.467394:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467408:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467415:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467423:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467429:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869555.467434:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467441:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467469:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:1.0:1788869555.467473:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869555.467478:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467485:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf497 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467508:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467515:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467522:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467526:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869555.467529:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467535:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467541:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839c200) 00010000:00010000:1.0:1788869555.467544:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869555.467546:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467552:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf49e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467560:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467565:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467572:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467580:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869555.467584:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467624:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467632:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869555.467635:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869555.467638:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.467645:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869555.467731:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:12353:x1875765305101696:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 634us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.467739:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:0.0:1788869555.470748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.470985:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305101952 00000100:00100000:1.0:1788869555.470999:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305101952 00000100:00100000:1.0:1788869555.471066:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788869555.471077:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:12353:x1875765305101952:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869555.471355:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:12353:x1875765305101952:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 278us (619us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788869555.471363:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788869555.526243:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869555.526274:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325100544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869555.526359:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869555.526570:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325100544 00000100:00100000:3.0:1788869555.526579:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325100544 00000100:00100000:3.0:1788869555.526655:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788869555.526667:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325100544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869555.526710:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869555.526889:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325100544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869555.527054:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325100544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.527063:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788869555.542894:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.543147:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305102208 00000100:00100000:1.0:1788869555.543159:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305102208 00000100:00100000:1.0:1788869555.543239:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:1.0:1788869555.543252:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:12356:x1875765305102208:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869555.543282:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869555.543306:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca00b expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.543406:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.543422:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.543434:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.543445:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.543465:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.543471:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.543644:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf4c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.543654:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.543683:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869555.543705:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788869555.544284:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544295:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544302:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544307:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869555.544312:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544319:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544333:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:1.0:1788869555.544335:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869555.544341:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544347:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544366:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544438:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544465:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544471:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869555.544474:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544481:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544489:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839c200) 00010000:00010000:1.0:1788869555.544492:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869555.544494:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544500:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544549:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca00b expref: 63 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544565:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca00b expref: 62 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.544572:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869555.544575:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869555.544577:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e600, rc 0) 00000100:00100000:1.0:1788869555.545153:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:12356:x1875765305102208:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1900us (2265us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788869555.545176:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:2.0:1788869555.551768:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869555.551939:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305102336 00000100:00100000:3.0:1788869555.551950:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305102336 00000100:00100000:3.0:1788869555.552157:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788869555.552189:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:2408:x1875765305102336:12345-192.168.204.54@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788869555.552201:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1788869555.552209:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869555.552241:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf4c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca00b expref: 62 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.552265:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869555.552271:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869555.552299:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305102464 00000100:00100000:1.0:1788869555.552306:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305102464 00000100:00100000:3.0:1788869555.552341:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:2408:x1875765305102336:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 156us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.552349:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:1.0:1788869555.552358:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:12356:x1875765305102464:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788869555.552514:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.552532:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.552544:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.552582:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.552616:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.552624:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.552630:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869555.552637:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.552649:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.552659:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869555.552670:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869555.552675:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.552681:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869555.552872:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:12356:x1875765305102464:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 514us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.552880:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:3.0:1788869555.553895:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1788869555.558037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.558286:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305102720 00000100:00100000:1.0:1788869555.558299:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305102720 00000100:00100000:1.0:1788869555.558366:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1788869555.558384:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:12356:x1875765305102720:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869555.558706:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:12356:x1875765305102720:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 323us (679us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788869555.558714:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1788869555.652673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869555.652721:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869555.652759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869555.652794:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869555.652814:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869555.652835:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.652990:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305102848 00000100:00100000:1.0:1788869555.653004:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305102848 00000100:00100000:0.0:1788869555.653044:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305103232 00000100:00100000:0.0:1788869555.653051:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305103232 00000100:00100000:1.0:1788869555.653072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 398 00000100:00100000:1.0:1788869555.653085:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2407:x1875765305102848:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869555.653116:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305103360 00000100:00100000:0.0:1788869555.653120:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305103360 00000100:00100000:0.0:1788869555.653152:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:1.0:1788869555.653175:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2407:x1875765305102848:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 91us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.653182:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305103232:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869555.653190:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 398 00000100:00100000:0.0:1788869555.653223:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305103232:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 46us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.653253:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:1.0:1788869555.653262:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2408:x1875765305103360:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869555.653291:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2408:x1875765305103360:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.653304:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:1.0:1788869555.653326:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305102976 00000100:00100000:1.0:1788869555.653330:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305102976 00000100:00100000:1.0:1788869555.653352:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305103488 00000100:00100000:1.0:1788869555.653354:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305103488 00000100:00100000:1.0:1788869555.653369:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305103104 00000100:00100000:1.0:1788869555.653371:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305103104 00000100:00100000:0.0:1788869555.653386:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:1.0:1788869555.653392:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 363 00000100:00100000:1.0:1788869555.653400:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:2407:x1875765305102976:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:0.0:1788869555.653414:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869555.653419:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869555.653423:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869555.653426:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869555.653440:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:2407:x1875765305102976:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.653479:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 364 00000100:00100000:0.0:1788869555.653488:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305103488:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869555.653519:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305103488:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.653526:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 364 00000100:00100000:0.0:1788869555.653546:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 365 00000100:00100000:0.0:1788869555.653553:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305103104:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869555.653580:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305103104:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.653613:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 365 00000100:00100000:1.0:1788869555.653718:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 363 00000100:00100000:2.0:1788869555.653992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.655181:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305103616 00000100:00100000:1.0:1788869555.655197:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305103616 00000100:00100000:1.0:1788869555.655389:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 366 00000100:00100000:1.0:1788869555.655399:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305103616:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869555.655479:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305103616:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 82us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.655486:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 366 00000100:00080000:2.0:1788869555.655547:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869555.727869:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.728073:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305103872 00000100:00100000:1.0:1788869555.728087:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305103872 00000100:00100000:1.0:1788869555.728159:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:1.0:1788869555.728169:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+62:12374:x1875765305103872:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1788869555.728191:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869555.728213:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca012 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.728368:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.728386:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.728400:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869555.728413:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788869555.728571:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca012 expref: 65 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.729978:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca012 expref: 64 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.729995:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869555.729999:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788869555.730003:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e400, rc 0) 00000100:00100000:1.0:1788869555.730088:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12374:x1875765305103872:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1919us (2234us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788869555.730097:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:0.0:1788869555.781349:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869555.781437:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305104000 00000100:00100000:1.0:1788869555.781461:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305104000 00000100:00100000:1.0:1788869555.781541:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:1.0:1788869555.781553:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12375:x1875765305104000:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869555.781579:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869555.781665:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca019 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.781773:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.781789:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.781803:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869555.781853:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788869555.781857:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869555.781880:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.781922:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf4eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca019 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.781944:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca019 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.781953:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:1.0:1788869555.781956:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869555.781960:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e000, rc 0) 00000100:00100000:1.0:1788869555.782029:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12375:x1875765305104000:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 479us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.782036:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:2.0:1788869555.796890:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869555.797103:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305104384 00000100:00100000:3.0:1788869555.797117:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305104384 00000100:00100000:3.0:1788869555.797187:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788869555.797208:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12375:x1875765305104384:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869555.797649:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12375:x1875765305104384:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 452us (771us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788869555.797668:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1788869555.811828:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869555.815534:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305104512 00000100:00100000:3.0:1788869555.815554:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305104512 00000100:00100000:2.0:1788869555.816125:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788869555.816139:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12375:x1875765305104512:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:2.0:1788869555.816172:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788869555.816202:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf482 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ffd expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.816228:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf4dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca012 expref: 65 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.816242:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6600/0x4c16c38a9b6cf37f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fb7 expref: 64 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.816253:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:2.0:1788869555.816258:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869555.816323:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+63:12375:x1875765305104512:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 188us (4509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.816331:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1788869555.819516:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869555.820177:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305104640 00000100:00100000:2.0:1788869555.820191:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305104640 00000100:00100000:2.0:1788869555.820431:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:2.0:1788869555.820441:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+63:12375:x1875765305104640:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:2.0:1788869555.820854:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.820874:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.820888:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869555.821100:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788869555.821237:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+63:12375:x1875765305104640:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 795us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.821246:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:3.0:1788869555.858293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869555.858512:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305104768 00000100:00100000:0.0:1788869555.858521:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305104768 00000100:00100000:0.0:1788869555.858609:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:0.0:1788869555.858622:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+63:12377:x1875765305104768:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869555.858650:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869555.858697:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf500 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca020 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.858786:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.858804:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.858819:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.858831:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.858839:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.858846:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.858935:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.858946:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.858954:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869555.859010:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788869555.859016:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869555.859037:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859059:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859069:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859076:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859083:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859090:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869555.859095:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859103:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859117:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869555.859120:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869555.859125:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859132:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf507 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859146:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859153:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859165:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859171:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869555.859174:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859181:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859189:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839c200) 00010000:00010000:0.0:1788869555.859192:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869555.859195:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859200:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf50e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859231:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf500 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca020 expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859246:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca020 expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.859254:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869555.859255:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869555.859258:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4400, rc 0) 00000100:00100000:0.0:1788869555.859340:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12377:x1875765305104768:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 719us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.859357:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 184 00000040:00080000:0.0:1788869556.166696:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869556.166707:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869556.166752:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788869556.166761:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869556.167083:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325100672:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869556.167213:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869556.174814:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325100672:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869556.191764:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869556.191893:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305104896 00000100:00100000:1.0:1788869556.191919:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305104896 00000100:00100000:1.0:1788869556.191983:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:1.0:1788869556.191994:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12388:x1875765305104896:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788869556.192042:0:8260:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788869556.192183:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12388:x1875765305104896:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 190us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869556.192191:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:2.0:1788869556.200448:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869556.201172:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305105024 00000100:00100000:1.0:1788869556.201184:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305105024 00000100:00100000:1.0:1788869556.201260:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:1.0:1788869556.201270:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12388:x1875765305105024:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788869556.201490:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201509:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201615:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201698:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201707:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201715:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201748:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201773:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201781:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869556.201831:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788869556.201836:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869556.201850:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201861:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201868:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201875:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201881:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ea00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869556.201886:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201895:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201906:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:1.0:1788869556.201910:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869556.201914:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201931:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf51c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201948:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201954:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201960:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201965:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869556.201968:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201975:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201983:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8e2701ece200) 00010000:00010000:1.0:1788869556.201986:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869556.201989:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.201995:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf523 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.202026:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.202032:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.202046:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.202051:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869556.204184:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.204203:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.204614:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869556.204619:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869556.204626:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.204635:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf52a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869556.204800:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12388:x1875765305105024:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 3516us (4358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869556.204812:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:0.0:1788869556.218845:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869556.218999:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305105280 00000100:00100000:1.0:1788869556.219011:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305105280 00000100:00100000:1.0:1788869556.219084:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:1.0:1788869556.219095:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12388:x1875765305105280:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869556.219120:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869556.219148:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf531 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca027 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.219545:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.219565:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.219577:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869556.219614:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788869556.219848:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.219856:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.219863:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.219869:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869556.219874:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.219952:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.219966:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:1.0:1788869556.219969:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869556.219974:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.219993:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf538 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.220039:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf531 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca027 expref: 66 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.220049:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:1.0:1788869556.220052:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869556.220056:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6cf531 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca027 expref: 66 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.220068:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e400, rc 0) 00000100:00100000:1.0:1788869556.220240:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12388:x1875765305105280:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1146us (1407us total) trans 4294967460 rc 301/301 00000100:00100000:1.0:1788869556.220248:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:2.0:1788869556.228542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869556.228992:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305105408 00000100:00100000:0.0:1788869556.229004:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305105408 00000100:00100000:0.0:1788869556.229575:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:0.0:1788869556.229627:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12388:x1875765305105408:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869556.229688:0:6526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869556.229810:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12388:x1875765305105408:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 224us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869556.229818:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:0.0:1788869556.236432:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869556.242698:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305105664 00000100:00100000:2.0:1788869556.242724:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305105664 00000100:00100000:2.0:1788869556.242851:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:2.0:1788869556.242866:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12388:x1875765305105664:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869556.243433:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869556.243450:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788869556.243506:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf4f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca019 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.243556:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869556.243571:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869556.243668:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6600/0x4c16c38a9b6cf546 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca02e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869556.244479:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788869556.250645:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf54d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.250681:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf54d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.250727:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf54d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.250844:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6600/0x4c16c38a9b6cf546 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca02e expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.250875:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf54d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca02e expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.253857:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839c900) 00010000:00010000:2.0:1788869556.253863:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869556.253869:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6200, rc 0) 00000100:00100000:2.0:1788869556.254245:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12388:x1875765305105664:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 11374us (17823us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788869556.254257:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:2.0:1788869556.273347:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869556.273469:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305105920 00000100:00100000:1.0:1788869556.273484:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305105920 00000100:00100000:1.0:1788869556.273573:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:1.0:1788869556.273756:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12388:x1875765305105920:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788869556.273852:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869556.273907:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf54d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca02e expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.273932:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839c900) 00010000:00010000:1.0:1788869556.273950:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869556.273985:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274427:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274454:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274476:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274484:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274493:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274579:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274777:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274787:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274794:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869556.274800:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274810:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274821:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:1.0:1788869556.274835:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869556.274841:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274847:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf55b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274861:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274868:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274875:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274892:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ea00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869556.274896:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274902:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274911:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xa6c01701 (ffff8e2701ece200) 00010000:00010000:1.0:1788869556.274914:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869556.274916:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.274923:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6cf562 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa6c01701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869556.275226:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12388:x1875765305105920:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1638us (1886us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788869556.275243:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:1.0:1788869556.291207:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869556.291431:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305106048 00000100:00100000:2.0:1788869556.291462:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305106048 00000100:00100000:2.0:1788869556.291548:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:2.0:1788869556.291573:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12388:x1875765305106048:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869556.291645:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869556.291682:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6600/0x4c16c38a9b6cf569 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca035 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.291736:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.291777:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.291794:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.292132:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6600/0x4c16c38a9b6cf569 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca035 expref: 67 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.292163:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca035 expref: 66 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.292173:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:2.0:1788869556.292177:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869556.292181:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6200, rc 0) 00000100:00100000:2.0:1788869556.292268:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12388:x1875765305106048:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 709us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.292288:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:2.0:1788869556.301077:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.301475:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305106304 00000100:00100000:3.0:1788869556.301491:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305106304 00000100:00100000:3.0:1788869556.301575:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:3.0:1788869556.301625:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12388:x1875765305106304:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869556.301801:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.301838:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.301856:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869556.302120:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788869556.302132:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 490215544656ns, next at 491215540892ns, rc = 0 00000004:00010000:0.0:1788869556.304499:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015df5d40 reply state 0000000033423c05 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.304538:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.304551:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:0.0:1788869556.304554:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788869556.304618:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869556.304827:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12388:x1875765305106304:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 3234us (3762us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788869556.304839:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:3.0:1788869556.310728:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869556.310922:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305106432 00000100:00100000:0.0:1788869556.310936:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305106432 00000100:00100000:0.0:1788869556.311033:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:0.0:1788869556.311045:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12388:x1875765305106432:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869556.311086:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869556.311117:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca03c expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.311201:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca03c expref: 69 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.311219:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca03c expref: 69 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.311240:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:0.0:1788869556.311244:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869556.311249:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4000, rc 0) 00000100:00100000:0.0:1788869556.311325:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+69:12388:x1875765305106432:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 282us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869556.311333:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 193 00000001:00080000:1.0:1788869556.322485:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1788869556.322507:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1788869556.322685:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788869556.322709:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2702a28f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788869556.322716:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2703a7d400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2702a28780 00000020:00080000:1.0:1788869556.322720:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2703a7d700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2702befa00 00000100:00100000:3.0:1788869556.323281:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869556.323317:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325100928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788869556.323457:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869556.323581:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325100928 00000100:00100000:3.0:1788869556.323612:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325100928 00000100:00100000:3.0:1788869556.323695:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869556.323707:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325100928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788869556.323982:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325100928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 274us (523us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788869556.323990:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:3.0:1788869556.324054:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e270402d500/2, rc 0, transno 4294967314 00000100:00100000:3.0:1788869556.324062:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325100928:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788869556.324363:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324378:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324409:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324416:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869556.324422:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324431:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324464:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e280839ce00) 00010000:00010000:0.0:1788869556.324467:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869556.324475:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324492:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf2c2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324523:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324529:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324536:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324542:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869556.324545:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324573:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324583:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869556.324628:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869556.324633:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324639:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf2c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324655:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324660:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324667:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324672:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869556.324674:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324680:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324688:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839c200) 00010000:00010000:0.0:1788869556.324690:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869556.324694:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324707:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf308 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324725:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324732:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324738:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324744:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869556.324747:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324753:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324761:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869556.324764:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869556.324767:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324772:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6cf40b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324785:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324792:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324805:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324810:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869556.324813:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324820:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324829:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869556.324831:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869556.324834:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324840:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf42e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324853:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324860:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324866:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324872:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869556.324875:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324905:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324915:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869556.324917:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869556.324920:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324926:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6cf474 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324938:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324946:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324952:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324958:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869556.324961:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324967:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324975:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:0.0:1788869556.324977:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869556.324980:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.324998:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf577 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788869556.325025:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788869556.325275:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788869556.326843:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869556.326885:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325100800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788869556.326987:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869556.327797:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325100800 00000100:00100000:0.0:1788869556.327817:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325100800 00000100:00100000:0.0:1788869556.327905:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788869556.327917:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325100800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788869556.327958:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1788869556.328008:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ffbb0, atime: 0x6a9ffbb0, ctime: 0x6a9ffbb0, blocks: 0x8 00010000:00010000:0.0:1788869556.328021:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.328045:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788869556.328050:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869556.328058:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.328204:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.328217:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.328224:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.328258:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788869556.328550:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875765325100800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 633us (1561us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788869556.328974:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1788869556.329022:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869556.329031:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.329043:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869556.329049:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.329060:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.329172:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.329182:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf585 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.329213:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869556.329215:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869556.329217:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869556.330035:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869556.330044:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869556.330408:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869556.330472:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305106560 00000100:00100000:2.0:1788869556.330484:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305106560 00000100:00100000:2.0:1788869556.330541:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1788869556.330551:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2410:x1875765305106560:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000004:00080000:0.0:1788869556.331039:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2840f0b800/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788869556.331052:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325100800:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788869556.333248:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305106560:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 2683us (2832us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788869556.333274:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1788869556.349283:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.350106:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305106816 00000100:00100000:3.0:1788869556.350121:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305106816 00000100:00100000:3.0:1788869556.350246:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1788869556.350276:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+18:12388:x1875765305106816:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788869556.353041:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:12388:x1875765305106816:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 2748us (3752us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788869556.353057:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1788869556.364117:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869556.369690:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305107072 00000100:00100000:1.0:1788869556.369715:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305107072 00000100:00100000:1.0:1788869556.372828:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:1.0:1788869556.372862:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:12388:x1875765305107072:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869556.373058:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:12388:x1875765305107072:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 212us (8963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869556.373068:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:3.0:1788869556.377116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869556.379168:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305107200 00000100:00100000:0.0:1788869556.379196:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305107200 00000100:00100000:0.0:1788869556.379348:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:0.0:1788869556.379365:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:12388:x1875765305107200:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869556.379400:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869556.379444:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf58c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca043 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.379574:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf593 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.379630:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.379646:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869556.379716:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869556.379749:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.379787:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf58c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca043 expref: 21 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.379809:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca043 expref: 20 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.379821:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:0.0:1788869556.379840:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788869556.379846:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4800, rc 0) 00000100:00100000:0.0:1788869556.380340:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12388:x1875765305107200:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 974us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869556.380351:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:1.0:1788869556.385118:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.385211:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305107328 00000100:00100000:3.0:1788869556.385226:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305107328 00000100:00100000:3.0:1788869556.385311:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788869556.385325:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2407:x1875765305107328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869556.385351:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869556.385379:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca04a expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869556.385413:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffbb3, blocks: 0x0 00010000:00010000:3.0:1788869556.385451:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788869556.385457:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869556.385470:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca04a expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.385495:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca04a expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.385513:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9600, rc 0) 00000100:00100000:3.0:1788869556.385623:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2407:x1875765305107328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 301us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869556.385640:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:2.0:1788869556.393550:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.393785:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305107584 00000100:00100000:3.0:1788869556.393799:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305107584 00000100:00100000:0.0:1788869556.393970:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:0.0:1788869556.393987:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12388:x1875765305107584:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788869556.394167:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12388:x1875765305107584:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 183us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869556.394176:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:3.0:1788869556.404016:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.404083:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305107712 00000100:00100000:3.0:1788869556.404209:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305107712 00000100:00100000:3.0:1788869556.404385:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1788869556.404399:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:12388:x1875765305107712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869556.404427:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869556.404462:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca051 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.404505:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca04a expref: 9 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.404516:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869556.404521:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869556.404527:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 9 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.404998:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca04a expref: 9 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.405019:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca04a expref: 9 pid: 8442 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869556.405053:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1875765325101056:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869556.405826:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869556.414228:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1875765325101056:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869556.414320:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 9 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.414351:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8c00, rc 0) 00000100:00100000:3.0:1788869556.414520:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:12388:x1875765305107712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 10123us (10522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869556.414531:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1788869556.417261:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869556.417354:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305107840 00000100:00100000:0.0:1788869556.417373:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305107840 00010000:00010000:0.0:1788869556.417456:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca04a expref: 9 pid: 8442 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869556.417517:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:0.0:1788869556.417528:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2409:x1875765305107840:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869556.417551:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869556.417824:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca04a expref: 9 pid: 8442 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.417845:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca04a expref: 9 pid: 8442 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.417957:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cf59a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca04a expref: 9 pid: 8442 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.417996:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869556.418001:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869556.418013:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.418026:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.418078:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869556.418099:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1875765325101184:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788869556.418274:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a289c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788869556.423406:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869556.428299:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1875765325101184:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788869556.428342:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869556.428432:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2409:x1875765305107840:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 10904us (11179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869556.428455:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1788869556.434302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.434713:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305107968 00000100:00100000:3.0:1788869556.434731:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305107968 00002000:00100000:3.0:1788869556.434816:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8e2840f09500 x1875765305107968/t0(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:502/0 lens 504/0 e 0 to 0 dl 1788869567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869556.434829:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2840f09500 with x1875765305107968 ext(0->8) 00002000:00010000:3.0:1788869556.434837:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2840f09500 00000100:00100000:3.0:1788869556.434897:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788869556.434910:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305107968:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788869556.437225:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:2410:x1875765305107968:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 2301us (2923us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788869556.437245:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00002000:00100000:2.0:1788869556.437262:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8e2840f09500 x1875765305107968/t4294967316(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:502/0 lens 504/448 e 0 to 0 dl 1788869567 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869556.437272:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2840f09500 with x1875765305107968 ext(0->8) 00002000:00010000:2.0:1788869556.437281:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2840f09500 00000100:00100000:2.0:1788869556.446042:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.446119:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305108096 00000100:00100000:3.0:1788869556.446134:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305108096 00000100:00100000:3.0:1788869556.446219:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:3.0:1788869556.446232:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12388:x1875765305108096:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788869556.447074:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12388:x1875765305108096:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 840us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869556.447086:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:3.0:1788869556.451314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869556.454264:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305108224 00000100:00100000:2.0:1788869556.454287:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305108224 00000100:00100000:2.0:1788869556.454383:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1788869556.454399:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:2409:x1875765305108224:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788869556.458677:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1788869556.458707:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1788869556.458983:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2409:x1875765305108224:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 4580us (7678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.458998:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1788869556.471884:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.472114:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305108480 00000100:00100000:3.0:1788869556.472131:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305108480 00000100:00100000:3.0:1788869556.472209:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:3.0:1788869556.472224:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12388:x1875765305108480:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869556.472301:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869556.472341:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf593 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca043 expref: 20 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.472368:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:3.0:1788869556.472376:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869556.472420:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.472448:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.472461:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869556.472667:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea0a3dd7 reply state 00000000a199a8aa transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.472683:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.472710:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:3.0:1788869556.472713:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869556.472717:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869556.472878:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:12388:x1875765305108480:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 657us (1012us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1788869556.472887:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:1.0:1788869556.487925:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869556.487982:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305108608 00000100:00100000:1.0:1788869556.487997:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305108608 00000100:00100000:3.0:1788869556.488209:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788869556.488226:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305108608:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869556.488497:0:11338:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788869556.488502:0:11338:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788869554 00002000:00010000:3.0:1788869556.488505:0:11338:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788869552 00002000:00010000:3.0:1788869556.488507:0:11338:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788869555 -> 1788869554 00002000:00010000:3.0:1788869556.488509:0:11338:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788869556.488611:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305108608:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 389us (703us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788869556.488622:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1788869556.503114:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869556.503169:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305108864 00000100:00100000:2.0:1788869556.503192:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305108864 00000100:00100000:2.0:1788869556.503280:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:2.0:1788869556.503295:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:12388:x1875765305108864:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788869556.503406:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.503472:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca035 expref: 21 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.503483:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.503537:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca035 expref: 21 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.503555:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca035 expref: 21 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869556.503579:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325101312:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869556.503977:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703952d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869556.508869:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869556.508933:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305108992 00000100:00100000:2.0:1788869556.508947:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305108992 00010000:00010000:2.0:1788869556.509013:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca035 expref: 22 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869556.511251:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1788869556.511277:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:2409:x1875765305108992:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869556.511302:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869556.511315:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca035 expref: 22 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.511348:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca035 expref: 22 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.511379:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:2.0:1788869556.511387:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.511399:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.511409:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.511445:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869556.511523:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:2409:x1875765305108992:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 258us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.511532:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00010000:00010000:3.0:1788869556.511925:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf570 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca035 expref: 21 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869556.511946:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325101312:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869556.511990:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.512002:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.512021:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.512088:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.512097:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.512105:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.512113:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869556.512118:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.512126:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.512139:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:3.0:1788869556.512142:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788869556.512146:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.512152:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf5af lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869556.512398:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12388:x1875765305108864:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 9105us (9302us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788869556.512409:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:2.0:1788869556.520968:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.521832:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305109120 00000100:00100000:3.0:1788869556.521848:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305109120 00000100:00100000:3.0:1788869556.521935:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1788869556.521947:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2409:x1875765305109120:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788869556.522014:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.522048:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.522059:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869556.522076:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869556.522081:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.522136:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.522155:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 8 pid: 8443 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869556.522174:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1875765325101440:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869556.522300:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869556.525281:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1875765325101440:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869556.525334:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869556.525666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.526034:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305109248 00000100:00100000:3.0:1788869556.526047:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305109248 00010000:00010000:3.0:1788869556.526103:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 9 pid: 8443 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869556.526157:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:3.0:1788869556.526169:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2410:x1875765305109248:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869556.526189:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869556.526223:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 9 pid: 8443 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.526239:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 9 pid: 8443 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.526269:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000834a1269/0x4c16c38a9b6cf5a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca051 expref: 9 pid: 8443 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.526288:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869556.526293:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869556.526300:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.526312:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.526820:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869556.526907:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305109248:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 738us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869556.526918:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00010000:00010000:2.0:1788869556.533146:0:8443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.533176:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.533227:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.533251:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.533261:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.533269:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869556.533275:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.533285:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.533321:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.533331:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cf5b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869556.533512:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2409:x1875765305109120:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 11560us (12552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.533524:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1788869556.540724:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869556.540793:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305109504 00000100:00100000:0.0:1788869556.540811:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305109504 00000100:00100000:0.0:1788869556.540898:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:0.0:1788869556.540912:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12388:x1875765305109504:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788869556.541047:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.541072:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fda expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.541083:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.541134:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fda expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.541153:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fda expref: 20 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869556.541175:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270417ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325101568:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869556.541302:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869556.545950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869556.546090:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305109632 00000100:00100000:1.0:1788869556.546093:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270417ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325101568:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869556.546108:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305109632 00010000:00010000:1.0:1788869556.546138:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.546170:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fda expref: 21 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869556.546225:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1788869556.546237:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:2410:x1875765305109632:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869556.546259:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869556.546268:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fda expref: 21 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.546300:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fda expref: 21 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.546336:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf404 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9fda expref: 21 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.546355:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:0.0:1788869556.546363:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.546378:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.546391:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.546442:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869556.546531:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:2410:x1875765305109632:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 296us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869556.546541:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00010000:00010000:1.0:1788869556.546636:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.546646:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.547087:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.547107:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca03c expref: 20 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.547117:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.547162:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca03c expref: 20 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.547180:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca03c expref: 20 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869556.547198:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325101696:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869556.547293:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869556.550929:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325101824:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.551051:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869556.551098:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325102208:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.551118:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325102336:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.551168:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869556.551484:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325102848:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.551529:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869556.551635:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325101952:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.551668:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869556.551694:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325102464:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.551785:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869556.551810:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325102976:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.551835:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869556.551850:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869556.551857:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325102080:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.552195:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869556.552226:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325102592:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.552255:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869556.552268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325103104:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.552303:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869556.552306:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325102336 00000100:00100000:2.0:1788869556.552326:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325102336 00000100:00100000:0.0:1788869556.552356:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325101824 00000100:00100000:0.0:1788869556.552366:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325101824 00000100:00100000:2.0:1788869556.552409:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325102080 00000100:00100000:2.0:1788869556.552446:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325102080 00000100:00100000:2.0:1788869556.552478:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788869556.552489:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325102336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869556.552674:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325102336:12345-0@lo:400:kworker.0 Request processed in 187us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.552683:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788869556.552700:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788869556.552706:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325102080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869556.552741:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325102080:12345-0@lo:400:kworker.0 Request processed in 35us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.552748:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788869556.552769:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325102848 00000100:00100000:2.0:1788869556.552773:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325102848 00000100:00100000:2.0:1788869556.552801:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325101952 00000100:00100000:2.0:1788869556.552804:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325101952 00000100:00100000:2.0:1788869556.552814:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325102464 00000100:00100000:2.0:1788869556.552817:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325102464 00000100:00100000:2.0:1788869556.552829:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325102976 00000100:00100000:2.0:1788869556.552832:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325102976 00000100:00100000:2.0:1788869556.552842:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325102592 00000100:00100000:2.0:1788869556.552844:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325102592 00000100:00100000:2.0:1788869556.552859:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788869556.552864:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270417ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325102848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869556.552894:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270417ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325102848:12345-0@lo:400:kworker.0 Request processed in 29us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.552900:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788869556.552911:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788869556.552917:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325101952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869556.552956:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325101952:12345-0@lo:400:kworker.0 Request processed in 39us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.552963:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788869556.552975:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788869556.552981:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325102464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.553377:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869556.553412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325102720:0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.553463:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869556.553617:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325102464:12345-0@lo:400:kworker.0 Request processed in 31us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.553625:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788869556.553641:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325102208 00000100:00100000:2.0:1788869556.553646:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325102208 00000100:00100000:2.0:1788869556.553666:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788869556.553672:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325102976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869556.553709:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325102976:12345-0@lo:400:kworker.0 Request processed in 37us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.553715:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788869556.553727:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788869556.553734:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325102592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869556.553765:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325102592:12345-0@lo:400:kworker.0 Request processed in 31us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.553771:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788869556.553783:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788869556.553789:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325102208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869556.553834:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325102208:12345-0@lo:400:kworker.0 Request processed in 46us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869556.553972:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788869556.553992:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325101824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.554069:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325101824:12345-0@lo:400:kworker.0 Request processed in 86us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869556.554080:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325103104 00000100:00100000:0.0:1788869556.554081:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788869556.554090:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325103104 00000100:00100000:2.0:1788869556.554376:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788869556.554683:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325102720 00000100:00100000:3.0:1788869556.554689:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325102720 00000100:00100000:3.0:1788869556.554731:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788869556.554741:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325103104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.554804:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325103104:12345-0@lo:400:kworker.0 Request processed in 66us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869556.554811:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788869556.554823:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788869556.554830:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325102720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.554865:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325102720:12345-0@lo:400:kworker.0 Request processed in 37us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869556.554872:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788869556.555322:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f08700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325101696:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869556.555350:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788869556.555386:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869556.555391:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869556.555395:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869556.555397:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869556.556322:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.556374:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325102848:0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.556402:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325101824:0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.556414:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325102336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.556465:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325102080:0@lo:400:kworker.0 00010000:00080000:3.0:1788869556.556480:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f1f80 x1875765325102592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869556.556489:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325102592:0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.556501:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325103104:0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.556511:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325101952:0@lo:400:kworker.0 00000100:00100000:3.0:1788869556.556534:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325102464:0@lo:400:kworker.0 00010000:00080000:3.0:1788869556.556545:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a8380 x1875765325102976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869556.556553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325102976:0@lo:400:kworker.0 00000100:00100000:2.0:1788869556.556787:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325102208:0@lo:400:kworker.0 00000100:00100000:2.0:1788869556.556803:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325102720:0@lo:400:kworker.0 00000100:00100000:0.0:1788869556.556909:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305109760 00000100:00100000:0.0:1788869556.556925:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305109760 00010000:00010000:0.0:1788869556.556990:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca03c expref: 21 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869556.557042:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1788869556.557066:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:2410:x1875765305109760:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869556.557089:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869556.557098:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca03c expref: 21 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.557116:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca03c expref: 21 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.557150:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf57e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca03c expref: 21 pid: 8260 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.557169:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:0.0:1788869556.557176:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.557187:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.557196:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869556.557230:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869556.557309:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:2410:x1875765305109760:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 244us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869556.557319:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00010000:00010000:2.0:1788869556.557328:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.557368:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869556.557546:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788869556.557730:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1788869556.557772:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788869556.557852:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875765325103232:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788869556.557916:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869556.557951:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703952300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869556.563082:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325103232 00000100:00100000:0.0:1788869556.563111:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325103232 00000100:00100000:0.0:1788869556.563209:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788869556.563222:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1875765325103232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788869556.563510:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1875765325103232:12345-0@lo:1000:mdt00_000.0 Request processed in 290us (5593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869556.563519:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788869556.565105:0:6524:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967314 gen 2 00000004:00080000:3.0:1788869556.565120:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e270402d500, transno 4294967314 00000100:00100000:3.0:1788869556.565165:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875765325103232:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788869556.565771:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1788869556.566107:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703945c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875765325103360:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788869556.566349:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869556.566399:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869556.566638:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325103360 00000100:00100000:2.0:1788869556.566656:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325103360 00000100:00100000:2.0:1788869556.566737:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788869556.566753:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875765325103360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788869556.567012:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1875765325103360:12345-0@lo:1000:mdt00_000.0 Request processed in 263us (663us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788869556.567035:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788869556.567198:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703945c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875765325103360:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788869556.567574:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567633:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567642:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567650:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869556.567655:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567664:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567683:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:3.0:1788869556.567687:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869556.567693:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567700:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f000/0x4c16c38a9b6cf5c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567726:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567732:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567738:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567743:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869556.567753:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567759:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567767:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869556.567769:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869556.567772:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567778:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf4f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567805:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567820:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca020 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567831:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.567867:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca020 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.569015:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca020 expref: 23 pid: 6526 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869556.569034:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325103488:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869556.569138:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869556.579735:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869556.581224:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305109888 00000100:00100000:3.0:1788869556.581240:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305109888 00010000:00010000:3.0:1788869556.581313:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca020 expref: 24 pid: 6526 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869556.581362:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1788869556.581373:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:2410:x1875765305109888:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869556.581402:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869556.581411:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca020 expref: 24 pid: 6526 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.581426:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca020 expref: 24 pid: 6526 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.581461:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869556.581467:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.581478:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.581486:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.581508:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869556.581567:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:2410:x1875765305109888:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 195us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869556.581574:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00010000:00010000:2.0:1788869556.584022:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf515 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca020 expref: 23 pid: 6526 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869556.584047:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325103488:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869556.584074:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586221:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586239:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586263:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586270:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586278:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586284:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869556.586289:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586296:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586315:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869556.586318:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869556.586324:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586331:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586346:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586375:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586382:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586398:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869556.586402:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586410:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586420:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e280839cf00) 00010000:00010000:3.0:1788869556.586423:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869556.586426:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.586443:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869556.586683:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:12388:x1875765305109504:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 45771us (45970us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788869556.586696:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 200 00000020:00080000:3.0:1788869556.586704:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788869556.588114:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869556.588123:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869556.588668:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788869556.588680:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869556.602099:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869556.602891:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305110144 00000100:00100000:1.0:1788869556.602912:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305110144 00000100:00100000:1.0:1788869556.603025:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1788869556.603042:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28268b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:12388:x1875765305110144:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788869556.603463:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788869556.603530:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:1.0:1788869556.603576:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.603625:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.603640:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.603651:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.603659:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.603666:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869556.603699:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788869556.603835:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28268b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:12388:x1875765305110144:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 795us (1750us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788869556.603845:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000020:00080000:1.0:1788869556.603853:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788869556.603861:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869556.604996:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.605011:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869556.605016:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.605026:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.605047:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:2.0:1788869556.605051:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788869556.605056:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.605062:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf5d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.605085:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869556.605087:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869556.605109:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869556.899408:0:14664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869556.899420:0:14664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869556.899460:0:14664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788869556.899471:0:14664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869557.014555:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869557.014657:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305110400 00000100:00100000:0.0:1788869557.014667:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305110400 00000100:00100000:0.0:1788869557.014742:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:0.0:1788869557.014753:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:12398:x1875765305110400:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869557.014782:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869557.014807:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf5d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca058 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.014920:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.014937:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.014949:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869557.014960:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788869557.015065:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf5d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca058 expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.015084:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca058 expref: 26 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.015116:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869557.015120:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869557.015124:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5200, rc 0) 00000100:00100000:0.0:1788869557.015181:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+26:12398:x1875765305110400:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 430us (637us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788869557.015189:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00080000:1.0:1788869557.015910:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869557.023223:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.023823:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305110528 00000100:00100000:3.0:1788869557.023834:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305110528 00000100:00100000:3.0:1788869557.023895:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:3.0:1788869557.023907:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27042ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+26:12398:x1875765305110528:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1788869557.024015:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024035:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024049:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024067:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024076:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024083:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024194:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024204:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024212:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869557.024263:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024278:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024296:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024304:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024310:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.024315:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024324:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024337:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:3.0:1788869557.024340:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869557.024346:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024352:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf5ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024366:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024371:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024378:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024383:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.024393:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024400:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024408:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365cc00) 00010000:00010000:3.0:1788869557.024412:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869557.024415:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024431:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf5f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024451:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024458:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024464:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024470:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8c00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.024473:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024480:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024488:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365c400) 00010000:00010000:3.0:1788869557.024490:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869557.024499:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.024505:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf5fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869557.024635:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27042ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+26:12398:x1875765305110528:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 728us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.024645:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:0.0:1788869557.061802:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27041eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325103616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869557.061893:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869557.061983:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325103616 00000100:00100000:0.0:1788869557.061991:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325103616 00000100:00100000:0.0:1788869557.062051:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788869557.062063:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325103616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869557.062097:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869557.062150:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325103616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.062154:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325103744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869557.062162:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788869557.062193:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869557.062232:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325103744 00000100:00100000:3.0:1788869557.062236:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325103744 00000100:00100000:3.0:1788869557.062264:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788869557.062271:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325103744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869557.062283:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869557.062315:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325103744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.062321:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788869557.062366:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325103744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869557.062551:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27041eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325103616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869557.088768:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.088837:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305110784 00000100:00100000:3.0:1788869557.088858:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305110784 00000100:00100000:3.0:1788869557.088974:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:3.0:1788869557.088989:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+26:12401:x1875765305110784:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869557.089023:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869557.089052:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf603 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca05f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089180:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089197:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089212:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089228:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089236:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089242:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089372:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089380:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089386:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869557.089396:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788869557.089491:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089499:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089513:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089518:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.089522:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089530:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089544:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:3.0:1788869557.089548:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869557.089553:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089559:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf60a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089572:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089577:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089582:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089612:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.089616:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089631:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089639:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c400) 00010000:00010000:3.0:1788869557.089642:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869557.089645:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089650:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf611 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089694:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf603 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca05f expref: 29 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089711:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca05f expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.089718:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:3.0:1788869557.089721:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869557.089723:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8200, rc 0) 00000100:00100000:3.0:1788869557.089807:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+28:12401:x1875765305110784:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 821us (1054us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788869557.089815:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:1.0:1788869557.096411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.099202:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305110912 00000100:00100000:3.0:1788869557.099218:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305110912 00000100:00100000:3.0:1788869557.099361:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:3.0:1788869557.099375:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+28:12401:x1875765305110912:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788869557.099481:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.099500:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.099514:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.099555:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.099563:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.099572:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.099578:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.099583:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.099622:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.099635:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:3.0:1788869557.099638:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869557.099644:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.099651:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf626 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869557.099762:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2809e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+28:12401:x1875765305110912:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 389us (3362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.099770:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:2.0:1788869557.107154:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869557.110922:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305111168 00000100:00100000:1.0:1788869557.110942:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305111168 00000100:00100000:1.0:1788869557.111059:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1788869557.111072:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+28:12401:x1875765305111168:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869557.111374:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+29:12401:x1875765305111168:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 304us (4229us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788869557.111383:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1788869557.166619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.168025:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305111424 00000100:00100000:3.0:1788869557.168043:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305111424 00000100:00100000:3.0:1788869557.168110:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:3.0:1788869557.168122:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+29:11934:x1875765305111424:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788869557.168151:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869557.168972:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf62d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca066 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.169103:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.169121:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca05f expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.169131:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.169166:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca05f expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.169987:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca05f expref: 30 pid: 6526 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869557.170005:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325103872:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869557.170130:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869557.186094:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869557.186139:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305111552 00000100:00100000:1.0:1788869557.186148:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305111552 00010000:00010000:1.0:1788869557.186492:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca05f expref: 31 pid: 6526 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869557.186531:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:1.0:1788869557.186542:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+31:2410:x1875765305111552:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869557.186558:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869557.186566:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca05f expref: 31 pid: 6526 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.186580:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca05f expref: 31 pid: 6526 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.186631:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:1.0:1788869557.186636:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.186648:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.186670:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.186691:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869557.186749:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+31:2410:x1875765305111552:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 211us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869557.186757:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00010000:00010000:0.0:1788869557.189140:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf618 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca05f expref: 30 pid: 6526 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869557.189179:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325103872:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869557.189202:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.189213:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.189239:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869557.189266:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788869557.189454:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf62d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca066 expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.189472:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca066 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.189482:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:0.0:1788869557.189486:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869557.189491:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8c00, rc 0) 00000100:00100000:0.0:1788869557.189622:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:11934:x1875765305111424:12345-192.168.204.54@tcp:101:bash.0 Request processed in 21463us (23001us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788869557.189633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:1.0:1788869557.193566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.193724:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305111680 00000100:00100000:2.0:1788869557.193738:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305111680 00000100:00100000:2.0:1788869557.193795:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:2.0:1788869557.193806:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2704192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:11934:x1875765305111680:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869557.193845:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869557.193940:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf642 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca06d expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.193977:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf649 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.193991:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf649 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.194013:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf649 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.194150:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf642 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca06d expref: 32 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.194301:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf649 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca06d expref: 31 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.194322:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:2.0:1788869557.194327:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869557.194331:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6200, rc 0) 00000100:00100000:2.0:1788869557.194400:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2704192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+31:11934:x1875765305111680:12345-192.168.204.54@tcp:101:bash.0 Request processed in 596us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.194407:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:1.0:1788869557.209078:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.209327:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305111936 00000100:00100000:3.0:1788869557.209338:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305111936 00000100:00100000:3.0:1788869557.209399:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:3.0:1788869557.209410:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+31:11934:x1875765305111936:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:3.0:1788869557.209696:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.209715:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.209727:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869557.210379:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1788869557.210414:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008560d38c reply state 00000000ac1be703 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.210441:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.210450:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:3.0:1788869557.210453:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869557.210458:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788869557.210509:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1788869557.210666:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+35:11934:x1875765305111936:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1252us (1594us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788869557.210674:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 207 00000020:00080000:3.0:1788869557.210681:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788869557.217724:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.217850:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305112064 00000100:00100000:2.0:1788869557.217862:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305112064 00000100:00100000:2.0:1788869557.217931:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:2.0:1788869557.217942:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+35:11934:x1875765305112064:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869557.217977:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869557.218012:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf657 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca074 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.218078:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf657 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca074 expref: 36 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.218094:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf657 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca074 expref: 36 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.218112:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:2.0:1788869557.218115:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869557.218119:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6400, rc 0) 00000100:00100000:2.0:1788869557.218341:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:11934:x1875765305112064:12345-192.168.204.54@tcp:101:bash.0 Request processed in 400us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.218368:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:1.0:1788869557.224014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.224118:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305112192 00000100:00100000:2.0:1788869557.224129:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305112192 00000100:00080000:1.0:1788869557.224266:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869557.224364:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1788869557.224376:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:11934:x1875765305112192:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869557.224398:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869557.224435:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca07b expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869557.224462:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ffbb2, atime: 0x6a9ffbb0, ctime: 0x6a9ffbb2, blocks: 0x8 00010000:00010000:2.0:1788869557.224486:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1788869557.224492:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869557.224500:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca07b expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.224519:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca07b expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.224534:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6600, rc 0) 00000100:00100000:2.0:1788869557.224641:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:11934:x1875765305112192:12345-192.168.204.54@tcp:101:bash.0 Request processed in 268us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.224649:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:0.0:1788869557.229989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.230125:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305112320 00000100:00100000:3.0:1788869557.230152:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305112320 00002000:00010000:3.0:1788869557.230206:0:8446:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1788869557.230211:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e27041eaa00 with x1875765305112320 ext(0->18446744073709551615) 00002000:00010000:3.0:1788869557.230227:0:8446:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e27041eaa00. 00000100:00100000:3.0:1788869557.230267:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788869557.230277:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27041eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2409:x1875765305112320:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:3.0:1788869557.230742:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788869557.230747:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788869554 -> 1788869556 00002000:00010000:3.0:1788869557.230750:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788869552 -> 1788869552 00002000:00010000:3.0:1788869557.230753:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788869554 -> 1788869556 00002000:00010000:3.0:1788869557.230755:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788869557.230866:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27041eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2409:x1875765305112320:12345-192.168.204.54@tcp:10:bash.0 Request processed in 589us (892us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788869557.230875:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00002000:00010000:3.0:1788869557.230881:0:8446:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1788869557.230883:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e27041eaa00 with x1875765305112320 ext(0->18446744073709551615) 00002000:00010000:3.0:1788869557.230888:0:8446:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e27041eaa00. 00000100:00100000:0.0:1788869557.315808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.315933:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305112448 00000100:00100000:3.0:1788869557.315946:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305112448 00000100:00100000:3.0:1788869557.316053:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:3.0:1788869557.316065:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:12415:x1875765305112448:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1788869557.316160:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316194:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316232:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316251:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316259:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316266:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316373:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316384:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316392:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869557.316463:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316476:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316483:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316490:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316508:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.316513:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316521:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316536:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:3.0:1788869557.316539:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869557.316544:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316551:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf665 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316567:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316573:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316578:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316583:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.316646:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316653:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316671:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c400) 00010000:00010000:3.0:1788869557.316674:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869557.316677:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316682:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf66c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316698:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316703:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316709:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316713:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.316716:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316721:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316727:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:3.0:1788869557.316729:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869557.316731:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.316737:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf673 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869557.316838:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:12415:x1875765305112448:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 773us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.316847:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:1.0:1788869557.364190:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.365950:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305112704 00000100:00100000:2.0:1788869557.365970:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305112704 00000100:00100000:2.0:1788869557.366120:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:2.0:1788869557.366132:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+36:12418:x1875765305112704:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869557.366185:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869557.366214:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf67a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca082 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366293:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366309:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366320:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366335:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366342:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366349:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366494:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf68f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366504:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf68f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366511:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf68f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869557.366522:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788869557.366667:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366676:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366683:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366690:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869557.366694:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366702:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366716:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869557.366719:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869557.366726:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366732:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cf681 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366749:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366755:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366760:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366764:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869557.366774:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366780:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366787:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e280839ce00) 00010000:00010000:2.0:1788869557.366790:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869557.366793:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366799:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7200/0x4c16c38a9b6cf688 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366866:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d7a00/0x4c16c38a9b6cf67a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca082 expref: 39 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366882:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf68f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca082 expref: 38 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.366890:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:2.0:1788869557.366892:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788869557.366895:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edac00, rc 0) 00000100:00100000:2.0:1788869557.366978:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+38:12418:x1875765305112704:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 847us (2808us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788869557.366985:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:0.0:1788869557.371837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869557.372035:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305112832 00000100:00100000:1.0:1788869557.372047:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305112832 00000100:00100000:1.0:1788869557.372105:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:1.0:1788869557.372117:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282a3fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+38:12418:x1875765305112832:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788869557.373510:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.373536:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca066 expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.373546:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.373609:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca066 expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.373651:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca066 expref: 38 pid: 6525 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869557.373671:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325104000:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869557.373791:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869557.377800:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875765325104000:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869557.377834:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869557.381748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869557.382189:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305113088 00000100:00100000:1.0:1788869557.382201:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305113088 00000100:00100000:1.0:1788869557.382262:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1788869557.382273:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:6179:x1875765305113088:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788869557.382753:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:6179:x1875765305113088:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 480us (1017us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788869557.382763:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1788869557.387624:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.387965:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305113216 00000100:00100000:3.0:1788869557.387978:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305113216 00010000:00010000:3.0:1788869557.388087:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca066 expref: 40 pid: 6525 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869557.388190:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:3.0:1788869557.388200:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:2410:x1875765305113216:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869557.388215:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869557.388222:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca066 expref: 40 pid: 6525 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.388235:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca066 expref: 40 pid: 6525 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.388258:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf634 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca066 expref: 40 pid: 6525 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.388275:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:3.0:1788869557.388280:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.388291:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.388319:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.388353:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869557.388431:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:2410:x1875765305113216:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 232us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.388439:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00010000:00010000:1.0:1788869557.389027:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.389037:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.389081:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.389088:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.389095:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.389125:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869557.389130:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.389138:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.389151:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:1.0:1788869557.389154:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869557.389159:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.389165:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e600/0x4c16c38a9b6cf69d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869557.389232:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282a3fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+38:12418:x1875765305112832:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 17116us (17408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869557.389239:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:1.0:1788869557.394779:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.394930:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305113472 00000100:00100000:3.0:1788869557.394942:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305113472 00000100:00100000:3.0:1788869557.395109:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1788869557.395120:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+38:12418:x1875765305113472:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869557.395405:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:12418:x1875765305113472:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 286us (635us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788869557.395413:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00010000:00010000:0.0:1788869557.445794:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869557.492331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.492508:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305113728 00000100:00100000:3.0:1788869557.492523:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305113728 00000100:00100000:3.0:1788869557.492635:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:3.0:1788869557.492647:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+39:12429:x1875765305113728:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1788869557.492675:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869557.492700:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca089 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.492779:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.492795:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.492827:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.492843:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.492850:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.492857:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.492983:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf6b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.493217:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.493228:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869557.493240:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788869557.493404:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493434:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493441:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493447:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869557.493451:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493459:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493473:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869557.493476:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869557.493481:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493488:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf6ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493503:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493509:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493515:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493520:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869557.493529:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493535:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493543:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c400) 00010000:00010000:2.0:1788869557.493545:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869557.493548:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493554:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf6b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493642:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca089 expref: 42 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493656:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca089 expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.493664:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:2.0:1788869557.493667:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869557.493669:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9600, rc 0) 00000100:00100000:2.0:1788869557.493748:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+41:12429:x1875765305113728:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1103us (1428us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788869557.493756:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:0.0:1788869557.505763:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.505871:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305113984 00000100:00100000:2.0:1788869557.505882:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305113984 00000100:00100000:2.0:1788869557.505944:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1788869557.505954:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+41:12429:x1875765305113984:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1788869557.506293:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+42:12429:x1875765305113984:12345-192.168.204.54@tcp:35:cat.0 Request processed in 339us (541us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788869557.506301:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:0.0:1788869557.530516:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.530742:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305114240 00000100:00100000:3.0:1788869557.530755:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305114240 00000100:00100000:3.0:1788869557.530829:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:3.0:1788869557.530839:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+42:12430:x1875765305114240:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:3.0:1788869557.530907:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788869557.530939:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6cf657 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca074 expref: 42 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.530981:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf6b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca089 expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531008:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf68f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca082 expref: 40 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531021:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6200/0x4c16c38a9b6cf649 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca06d expref: 39 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531031:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:3.0:1788869557.531036:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869557.531059:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531074:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531083:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531098:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531104:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531125:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531227:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531237:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531244:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869557.531485:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788869557.531786:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491445198176ns, next at 492444905724ns, rc = 0 00010000:00010000:3.0:1788869557.531844:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531854:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531861:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531868:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531874:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531880:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531893:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869557.531913:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531928:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531934:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531940:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.531945:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531953:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531962:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:3.0:1788869557.531965:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788869557.531969:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531974:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf6d5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531993:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.531999:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.532005:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.532010:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869557.532019:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.532026:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.532035:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:3.0:1788869557.532037:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869557.532040:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.532046:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8400/0x4c16c38a9b6cf6c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869557.532057:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039d4a713 reply state 0000000053517873 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.532066:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.532072:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c900) 00010000:00010000:3.0:1788869557.532074:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869557.532077:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869557.532318:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:12430:x1875765305114240:12345-192.168.204.54@tcp:36:rm.0 Request processed in 1477us (1824us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788869557.532326:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 213 00010000:00010000:0.0:1788869557.532404:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869557.532422:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.532428:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8c00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869557.532432:0:7475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.532437:0:7475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.532446:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:0.0:1788869557.532448:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788869557.532451:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.532456:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6cf6dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.532467:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869557.532469:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869557.532471:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869557.617402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.617555:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305114496 00000100:00100000:2.0:1788869557.617566:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305114496 00000100:00100000:2.0:1788869557.617672:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:2.0:1788869557.617689:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+40:12436:x1875765305114496:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869557.617720:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869557.617744:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf6e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca090 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.617885:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.617900:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.617914:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.617928:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.617935:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.617941:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869557.619458:0:8260:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788869557.619684:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619702:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619713:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619752:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619760:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619766:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619772:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869557.619776:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619784:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619797:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869557.619800:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869557.619805:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619811:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf6ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869557.619837:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4909872 reply state 000000006409ef72 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619848:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619855:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c900) 00010000:00010000:2.0:1788869557.619857:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869557.619860:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788869557.619896:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf6e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca090 expref: 43 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619912:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca090 expref: 42 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.619920:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e280839ce00) 00010000:00010000:2.0:1788869557.619922:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869557.619924:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edac00, rc 0) 00000100:00100000:2.0:1788869557.623483:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:12436:x1875765305114496:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5783us (6081us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788869557.624319:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:2.0:1788869557.628958:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869557.629104:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305114624 00000100:00100000:0.0:1788869557.629117:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305114624 00000100:00100000:0.0:1788869557.629211:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:0.0:1788869557.629222:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2408:x1875765305114624:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869557.629240:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869557.629262:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca097 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869557.629289:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869557.629332:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=491s v=(0 0) 00010000:00010000:0.0:1788869557.629337:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869557.629347:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca097 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.629371:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca097 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.629386:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4000, rc 0) 00000100:00100000:0.0:1788869557.629468:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2408:x1875765305114624:12345-192.168.204.54@tcp:101:bash.0 Request processed in 247us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.629475:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00080000:1.0:1788869557.630020:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869557.640100:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.640200:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305114752 00000100:00100000:3.0:1788869557.640211:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305114752 00000100:00100000:3.0:1788869557.640273:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1788869557.640284:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:12436:x1875765305114752:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788869557.640304:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869557.640339:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca09e expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.640391:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca097 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.640402:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869557.640407:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869557.640423:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.640464:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca097 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.640479:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca097 expref: 9 pid: 8440 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869557.640496:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1875765325104128:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869557.640627:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869557.644448:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869557.650568:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305114880 00000100:00100000:0.0:1788869557.650598:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305114880 00010000:00010000:0.0:1788869557.650654:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca097 expref: 10 pid: 8440 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869557.650702:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1788869557.650711:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:2410:x1875765305114880:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869557.650728:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869557.650753:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca097 expref: 10 pid: 8440 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.650769:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca097 expref: 10 pid: 8440 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.650823:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869557.650828:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869557.650838:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.650848:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.650886:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869557.650901:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1875765325104256:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788869557.650979:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2810071b40 going to sleep for 11 seconds 00010000:00010000:1.0:1788869557.651391:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6cf706 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca097 expref: 10 pid: 8440 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869557.651418:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1875765325104128:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869557.651443:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869557.651469:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8400, rc 0) 00000100:00100000:1.0:1788869557.651515:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:12436:x1875765305114752:12345-192.168.204.54@tcp:101:bash.0 Request processed in 11233us (11425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869557.651523:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:0.0:1788869557.654401:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1875765325104256:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788869557.654441:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869557.654508:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305114880:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3796us (10069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.654519:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:2.0:1788869557.662054:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.662263:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305115136 00000100:00100000:3.0:1788869557.662274:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305115136 00000100:00100000:3.0:1788869557.662333:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:3.0:1788869557.662343:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+43:12436:x1875765305115136:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1788869557.662675:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+44:12436:x1875765305115136:12345-192.168.204.54@tcp:35:bash.0 Request processed in 333us (630us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788869557.662699:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:1.0:1788869557.696291:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869557.696368:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.696646:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305115264 00000100:00100000:2.0:1788869557.696658:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305115264 00002000:00100000:2.0:1788869557.696714:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8e283f47ed80 x1875765305115264/t0(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:503/0 lens 504/0 e 0 to 0 dl 1788869568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869557.696755:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e283f47ed80 with x1875765305115264 ext(0->8) 00002000:00010000:2.0:1788869557.696763:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e283f47ed80 00000100:00100000:2.0:1788869557.696797:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788869557.696807:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2408:x1875765305115264:12345-192.168.204.54@tcp:4:bash.0 00000100:00100000:3.0:1788869557.697188:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305115392 00000100:00100000:3.0:1788869557.697194:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305115392 00000100:00100000:3.0:1788869557.697222:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:3.0:1788869557.697230:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2408:x1875765305115392:12345-192.168.204.54@tcp:16:kworker.0 00000100:00100000:2.0:1788869557.716051:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:2408:x1875765305115264:12345-192.168.204.54@tcp:4:bash.0 Request processed in 19224us (19750us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788869557.716067:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00002000:00100000:2.0:1788869557.716090:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8e283f47ed80 x1875765305115264/t4294967309(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:503/0 lens 504/448 e 0 to 0 dl 1788869568 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869557.716100:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e283f47ed80 with x1875765305115264 ext(0->8) 00002000:00010000:2.0:1788869557.716107:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e283f47ed80 00000001:00080000:3.0:1788869557.716712:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788869557.716757:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788869557.717039:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2408:x1875765305115392:12345-192.168.204.54@tcp:16:kworker.0 Request processed in 19799us (20660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869557.717051:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1788869557.886001:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869557.886137:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305115520 00000100:00100000:0.0:1788869557.886151:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305115520 00000100:00100000:0.0:1788869557.886232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:0.0:1788869557.886243:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+44:12452:x1875765305115520:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869557.886274:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869557.886302:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0a5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.886437:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf71b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.886465:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf71b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.886479:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf71b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869557.886538:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788869557.886541:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869557.886564:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf71b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.886667:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0a5 expref: 46 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.886689:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf71b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0a5 expref: 45 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.886699:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869557.886702:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869557.886706:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4800, rc 0) 00000100:00100000:0.0:1788869557.886833:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+45:12452:x1875765305115520:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 591us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.886841:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:0.0:1788869557.893233:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.893353:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305115776 00000100:00100000:2.0:1788869557.893376:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305115776 00000100:00100000:2.0:1788869557.893477:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:2.0:1788869557.893489:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+45:12452:x1875765305115776:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869557.893517:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869557.893542:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf722 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0ac expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.893730:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf729 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.893749:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.893797:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869557.893811:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788869557.893962:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf722 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0ac expref: 48 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.893984:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0ac expref: 47 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.893993:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e280839ce00) 00010000:00010000:2.0:1788869557.893997:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869557.894000:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edae00, rc 0) 00000100:00100000:2.0:1788869557.894070:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+47:12452:x1875765305115776:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 583us (859us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788869557.894078:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:1.0:1788869557.901348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869557.901418:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.901558:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305116160 00000100:00100000:2.0:1788869557.901571:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305116160 00000100:00100000:2.0:1788869557.901660:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:2.0:1788869557.901670:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+47:12452:x1875765305116160:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869557.901700:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869557.901725:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf737 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0b3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.901850:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf73e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.901884:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf73e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869557.901895:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305116032 00010000:00010000:2.0:1788869557.901897:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf73e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869557.901905:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305116032 00000004:00200000:2.0:1788869557.901910:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:0.0:1788869557.901994:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788869557.902002:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+50:2409:x1875765305116032:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869557.902011:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869557.902013:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf737 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0b3 expref: 51 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.902024:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf729 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0ac expref: 50 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.902034:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf73e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0b3 expref: 50 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.902043:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e280839ce00) 00010000:00010000:2.0:1788869557.902046:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788869557.902050:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e280839ce00) 00010000:00010000:2.0:1788869557.902051:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edba00, rc 0) 00010000:00010000:0.0:1788869557.902053:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869557.902195:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+49:12452:x1875765305116160:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 525us (787us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1788869557.902203:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:0.0:1788869557.914661:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+48:2409:x1875765305116032:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 12646us (13313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.914678:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788869557.917947:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869557.918199:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305116288 00000100:00100000:0.0:1788869557.918212:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305116288 00000100:00100000:0.0:1788869557.918292:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:0.0:1788869557.918303:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+6:2407:x1875765305116288:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:0.0:1788869557.918360:0:8743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.918389:0:8743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.918399:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869557.918415:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869557.918419:0:8743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.918488:0:8743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.918503:0:8743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 6 pid: 8442 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869557.918521:0:8743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8743:1875765325104384:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869557.918767:0:8743:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28100719c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869557.923869:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.924438:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305116416 00000100:00100000:3.0:1788869557.924450:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305116416 00010000:00010000:3.0:1788869557.924499:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 7 pid: 8442 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869557.924566:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:3.0:1788869557.924577:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305116416:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869557.924636:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788869557.924663:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788869557.924667:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788869556 00002000:00010000:3.0:1788869557.924670:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788869556 00002000:00010000:3.0:1788869557.924672:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788869557.924682:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 7 pid: 8442 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.924700:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 7 pid: 8442 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.924736:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869557.924760:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869557.924768:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.924780:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.924803:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869557.924867:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305116416:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 291us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.924875:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00010000:00010000:0.0:1788869557.925628:0:8743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f184bfe/0x4c16c38a9b6cf70d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca09e expref: 6 pid: 8442 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869557.925648:0:8743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8743:1875765325104384:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869557.925671:0:8743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.925681:0:8743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.925687:0:8743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.925710:0:8743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.925731:0:8743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.925739:0:8743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.925746:0:8743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869557.925750:0:8743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.925759:0:8743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.925773:0:8743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.925781:0:8743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd1a6f3/0x4c16c38a9b6cf74c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869557.925851:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305116288:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 7549us (7914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.925860:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1788869557.931484:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.931715:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305116672 00000100:00100000:3.0:1788869557.931728:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305116672 00000100:00100000:3.0:1788869557.931794:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1788869557.931805:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282a61e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+48:12452:x1875765305116672:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:3.0:1788869557.931881:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf73e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0b3 expref: 48 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869557.932215:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788869557.932251:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788869557.934335:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1788869557.934421:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.934447:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca090 expref: 52 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.934458:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.934522:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca090 expref: 52 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.934540:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca090 expref: 52 pid: 8260 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869557.934572:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875765325104512:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869557.934993:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869557.937940:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875765325104512:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869557.937971:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869557.942162:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869557.942344:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305116800 00000100:00100000:3.0:1788869557.942357:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305116800 00010000:00010000:3.0:1788869557.942415:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca090 expref: 53 pid: 8260 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869557.942506:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:3.0:1788869557.942519:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+53:2410:x1875765305116800:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869557.942539:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869557.942547:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca090 expref: 53 pid: 8260 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.942573:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca090 expref: 53 pid: 8260 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.942667:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf6f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca090 expref: 53 pid: 8260 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.942685:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e280839ce00) 00010000:00010000:3.0:1788869557.942690:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.942701:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.942710:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.942748:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869557.942813:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+52:2410:x1875765305116800:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 296us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.942821:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00010000:00010000:2.0:1788869557.943022:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.943031:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869557.943183:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1788869557.943314:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788869557.943438:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875765325104640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788869557.943494:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.943539:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039520c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869557.944699:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325104640 00000100:00100000:1.0:1788869557.944711:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325104640 00000100:00100000:1.0:1788869557.944765:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788869557.944774:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1875765325104640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788869557.944885:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1875765325104640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869557.944892:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788869557.945940:0:6528:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1788869557.945949:0:6528:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1788869557.945969:0:6528:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2840f0b800, transno 4294967308 00000100:00100000:2.0:1788869557.945983:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875765325104640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788869557.946190:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1788869557.946255:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875765325104768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788869557.946303:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.946338:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703952300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869557.946400:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325104768 00000100:00100000:1.0:1788869557.946418:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325104768 00000100:00100000:1.0:1788869557.946486:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788869557.946496:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1875765325104768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788869557.946672:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1875765325104768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (368us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788869557.946699:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788869557.949915:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875765325104768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788869557.950048:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788869557.950132:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.950143:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.950151:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.950157:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869557.950162:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.950193:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.950210:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e280839ce00) 00010000:00010000:2.0:1788869557.950213:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788869557.950219:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869557.950225:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9400/0x4c16c38a9b6cf753 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869557.950360:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788869557.950448:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788869557.950460:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 491863872147ns, next at 492863868843ns, rc = 0 00000001:00080000:2.0:1788869557.950467:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1788869557.950496:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e280839ce00) 00010000:00010000:2.0:1788869557.950499:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788869557.950506:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf73e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0b3 expref: 56 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869557.950882:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282a61e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:12452:x1875765305116672:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 19076us (19407us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788869557.950892:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000020:00080000:2.0:1788869557.950897:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788869557.959267:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869557.959364:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305116928 00000100:00100000:0.0:1788869557.959375:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305116928 00000100:00100000:0.0:1788869557.959459:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:0.0:1788869557.959492:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+55:12452:x1875765305116928:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869557.959521:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869557.959563:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf75a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0ba expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.959681:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf75a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0ba expref: 56 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.959698:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf75a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0ba expref: 56 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869557.959721:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869557.959723:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869557.959728:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5800, rc 0) 00000100:00100000:0.0:1788869557.959782:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+56:12452:x1875765305116928:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 294us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.959789:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:1.0:1788869557.966813:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869557.966969:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305117184 00000100:00100000:2.0:1788869557.966982:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305117184 00000100:00100000:2.0:1788869557.967064:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1788869557.967085:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+56:12452:x1875765305117184:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869557.967361:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:12452:x1875765305117184:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 278us (557us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788869557.967369:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1788869558.063942:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.064092:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305117312 00000100:00100000:3.0:1788869558.064104:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305117312 00000100:00100000:3.0:1788869558.064191:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:3.0:1788869558.064203:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:12462:x1875765305117312:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1788869558.064289:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064310:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064323:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064351:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064359:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064365:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064462:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064471:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064479:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869558.064528:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064542:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064549:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064556:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064562:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869558.064566:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064582:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064639:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:3.0:1788869558.064643:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869558.064649:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064656:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf761 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064671:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064677:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064684:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064689:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869558.064692:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064698:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064705:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c900) 00010000:00010000:3.0:1788869558.064708:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869558.064711:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064726:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf768 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064737:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064742:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064747:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064751:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869558.064755:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064760:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064768:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:3.0:1788869558.064770:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869558.064773:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.064779:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf76f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.065061:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:12462:x1875765305117312:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 858us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.065070:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:1.0:1788869558.108467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.108628:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305117568 00000100:00100000:0.0:1788869558.108640:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305117568 00000100:00100000:0.0:1788869558.108708:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:0.0:1788869558.108719:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+57:12465:x1875765305117568:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869558.108741:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869558.108764:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf776 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0c1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.108849:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.108885:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.108898:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.108912:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.108919:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.108925:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109059:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109068:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109076:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869558.109087:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788869558.109170:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109179:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109186:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109198:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.109203:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109211:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109223:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869558.109226:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869558.109231:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109238:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf77d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109253:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109259:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109264:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109270:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.109273:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109280:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109298:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c900) 00010000:00010000:0.0:1788869558.109301:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869558.109304:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109310:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf784 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109348:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf776 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c1 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109362:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c1 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.109370:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.109372:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869558.109374:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8600, rc 0) 00000100:00100000:0.0:1788869558.109465:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:12465:x1875765305117568:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 748us (1010us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788869558.109473:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:1.0:1788869558.112927:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.113026:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305117696 00000100:00100000:3.0:1788869558.113037:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305117696 00000100:00100000:3.0:1788869558.113107:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:3.0:1788869558.113119:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:12465:x1875765305117696:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788869558.113200:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.113218:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.113230:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.113267:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.113275:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.113284:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.113291:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869558.113295:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.113303:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.113315:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:3.0:1788869558.113318:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869558.113323:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.113341:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf799 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.113433:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:12465:x1875765305117696:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 316us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.113442:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:1.0:1788869558.116976:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869558.117131:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305117952 00000100:00100000:2.0:1788869558.117143:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305117952 00000100:00100000:2.0:1788869558.117256:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:2.0:1788869558.117268:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+59:12465:x1875765305117952:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869558.117532:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:12465:x1875765305117952:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 265us (564us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788869558.117539:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1788869558.211785:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.211964:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305118208 00000100:00100000:0.0:1788869558.211985:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305118208 00000100:00100000:0.0:1788869558.212059:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:0.0:1788869558.212070:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:12475:x1875765305118208:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869558.212096:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869558.212099:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869558.212279:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf71b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0a5 expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.212323:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869558.212328:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869558.212347:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf7a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0c8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.212503:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.212522:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c1 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.212531:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.212572:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c1 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.212652:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c1 expref: 60 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.212670:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325104896:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869558.212908:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28100719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869558.219636:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875765325104896:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869558.219683:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869558.220867:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.221022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305118336 00000100:00100000:0.0:1788869558.221049:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305118336 00010000:00010000:0.0:1788869558.221098:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c1 expref: 61 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.221158:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:0.0:1788869558.221169:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:2410:x1875765305118336:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869558.221186:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869558.221193:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c1 expref: 61 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.221207:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c1 expref: 61 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.221232:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf78b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c1 expref: 61 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.221250:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.221254:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.221264:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.221272:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.221308:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869558.221383:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:2410:x1875765305118336:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 216us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.221413:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00010000:00010000:2.0:1788869558.221843:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.221853:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869558.221874:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788869558.222041:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf7a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c8 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.222060:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c8 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.222068:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:2.0:1788869558.222071:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869558.222074:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a9600, rc 0) 00000100:00100000:2.0:1788869558.222108:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:12475:x1875765305118208:12345-192.168.204.54@tcp:101:bash.0 Request processed in 10040us (10351us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788869558.222243:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:1.0:1788869558.227279:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.227364:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305118464 00000100:00100000:3.0:1788869558.227377:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305118464 00000100:00100000:3.0:1788869558.227454:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:3.0:1788869558.227465:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+60:12475:x1875765305118464:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788869558.227494:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869558.227523:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0cf expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.227568:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.227584:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.227634:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.227768:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0cf expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.227790:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0cf expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.227811:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:3.0:1788869558.227814:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869558.227819:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8000, rc 0) 00000100:00100000:3.0:1788869558.227892:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:12475:x1875765305118464:12345-192.168.204.54@tcp:101:bash.0 Request processed in 428us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.227900:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:1.0:1788869558.232258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.232475:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305118720 00000100:00100000:3.0:1788869558.232489:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305118720 00000100:00100000:3.0:1788869558.232575:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:3.0:1788869558.232617:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+61:12475:x1875765305118720:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:3.0:1788869558.232953:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.232973:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.232985:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869558.233032:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:3.0:1788869558.233059:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011d526c7 reply state 0000000033423c05 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.233073:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.233081:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:3.0:1788869558.233084:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869558.233107:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869558.233227:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12475:x1875765305118720:12345-192.168.204.54@tcp:36:bash.0 Request processed in 641us (984us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788869558.233235:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 224 00000020:00080000:3.0:1788869558.233241:0:8260:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788869558.238066:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.238272:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305118848 00000100:00100000:3.0:1788869558.238288:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305118848 00000100:00100000:3.0:1788869558.238425:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:3.0:1788869558.238438:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12475:x1875765305118848:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788869558.238467:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869558.238504:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0d6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.238642:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.238659:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c8 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.238669:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.238711:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c8 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.238728:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c8 expref: 65 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.238744:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325105024:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869558.238957:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869558.243477:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.243637:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305118976 00000100:00100000:0.0:1788869558.243654:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305118976 00010000:00010000:0.0:1788869558.243716:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c8 expref: 66 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.243786:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:0.0:1788869558.243799:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:2409:x1875765305118976:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869558.243816:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869558.243825:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c8 expref: 66 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.243840:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c8 expref: 66 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.243872:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.243879:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.243893:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.243902:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.243924:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869558.244005:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:2409:x1875765305118976:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 208us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.244043:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00010000:00010000:3.0:1788869558.244672:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf7a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0c8 expref: 65 pid: 6524 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.244697:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325105024:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869558.244729:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.244743:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.244750:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869558.244849:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788869558.244855:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869558.244883:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.244928:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0d6 expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.244949:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0d6 expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.244957:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:3.0:1788869558.244959:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869558.244962:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8600, rc 0) 00000100:00100000:3.0:1788869558.245030:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12475:x1875765305118848:12345-192.168.204.54@tcp:101:bash.0 Request processed in 6595us (6977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.245049:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:1.0:1788869558.250178:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.250697:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305119232 00000100:00100000:0.0:1788869558.250710:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305119232 00000100:00100000:0.0:1788869558.250799:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1788869558.250812:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+64:12475:x1875765305119232:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1788869558.251118:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12475:x1875765305119232:12345-192.168.204.54@tcp:35:bash.0 Request processed in 309us (957us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788869558.251126:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:1.0:1788869558.351812:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.351907:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305119360 00000100:00100000:3.0:1788869558.351920:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305119360 00000100:00100000:3.0:1788869558.352000:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:3.0:1788869558.352013:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+65:12482:x1875765305119360:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869558.352047:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869558.352075:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf7d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0dd expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.352166:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.352183:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.352196:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869558.352252:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788869558.352257:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869558.352279:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.352307:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf7d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0dd expref: 67 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.352329:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0dd expref: 66 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.352359:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:3.0:1788869558.352362:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869558.352365:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9a00, rc 0) 00000100:00100000:3.0:1788869558.352439:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12482:x1875765305119360:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 429us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.352446:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:3.0:1788869558.357949:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869558.358232:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305119488 00000100:00100000:2.0:1788869558.358243:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305119488 00000100:00100000:2.0:1788869558.358316:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:2.0:1788869558.358327:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12482:x1875765305119488:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869558.358352:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869558.358379:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf7e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0e4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358461:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358478:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358491:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358503:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358510:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358516:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358627:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf7fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358662:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf7fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358668:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf7fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869558.358717:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788869558.358721:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869558.358739:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf7fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358750:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf7fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358771:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358777:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358784:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358791:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869558.358795:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358803:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358815:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869558.358817:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869558.358829:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358835:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf7ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358849:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358854:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358859:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358865:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869558.358867:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358872:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358880:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c900) 00010000:00010000:2.0:1788869558.358882:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869558.358886:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358891:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf7f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358915:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf7e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0e4 expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358941:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf7fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0e4 expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.358948:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:2.0:1788869558.358950:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869558.358953:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda400, rc 0) 00000100:00100000:2.0:1788869558.359041:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:12482:x1875765305119488:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 716us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.359048:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:1.0:1788869558.364725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869558.364820:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.365121:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305119872 00000100:00100000:0.0:1788869558.365137:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305119872 00000100:00100000:0.0:1788869558.365228:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1788869558.365240:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:2409:x1875765305119872:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869558.365261:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869558.365291:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf7fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0e4 expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.365313:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.365318:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869558.365383:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:2409:x1875765305119872:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 145us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.365391:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788869558.367210:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305119744 00000100:00100000:3.0:1788869558.367227:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305119744 00000100:00100000:3.0:1788869558.367340:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:3.0:1788869558.367352:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12482:x1875765305119744:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869558.367374:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869558.367409:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf802 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0eb expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.367552:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.367572:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0d6 expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.367582:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.367653:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0d6 expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.367699:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0d6 expref: 67 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.367716:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325105152:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869558.367893:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869558.376280:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325105152:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869558.376320:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869558.377190:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.377270:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305120000 00000100:00100000:0.0:1788869558.377282:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305120000 00010000:00010000:0.0:1788869558.377331:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0d6 expref: 68 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.377408:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:0.0:1788869558.377419:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:2409:x1875765305120000:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869558.377440:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869558.377448:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0d6 expref: 68 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.377461:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0d6 expref: 68 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.377487:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf7d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0d6 expref: 68 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.377506:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.377511:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.377523:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.377531:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.377566:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869558.377685:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:2409:x1875765305120000:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 267us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.377693:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00010000:00010000:3.0:1788869558.378026:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.378036:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869558.378061:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788869558.378207:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6cf802 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0eb expref: 68 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.378224:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0eb expref: 67 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.378232:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:3.0:1788869558.378234:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869558.378237:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8800, rc 0) 00000100:00100000:3.0:1788869558.378283:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:12482:x1875765305119744:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 10934us (13574us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788869558.378305:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:1.0:1788869558.383554:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.383775:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305120256 00000100:00100000:0.0:1788869558.383815:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305120256 00000100:00100000:0.0:1788869558.383912:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1788869558.383926:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:12482:x1875765305120256:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:0.0:1788869558.383951:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869558.383986:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf75a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0ba expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.384005:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.384010:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869558.384076:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12482:x1875765305120256:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 153us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.384084:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788869558.387425:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.387513:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305120384 00000100:00100000:0.0:1788869558.387527:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305120384 00000100:00100000:0.0:1788869558.387632:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:0.0:1788869558.387644:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12482:x1875765305120384:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:0.0:1788869558.387853:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.387879:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.387893:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869558.388043:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788869558.388148:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12482:x1875765305120384:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 507us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.388157:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:1.0:1788869558.392445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869558.392549:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305120512 00000100:00100000:2.0:1788869558.392563:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305120512 00000100:00100000:2.0:1788869558.392676:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:2.0:1788869558.392688:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+66:12482:x1875765305120512:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869558.392712:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869558.392740:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0f2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.392822:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.392835:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f2 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.392856:0:6524:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.392892:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f2 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.392910:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:2.0:1788869558.392913:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869558.392918:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f2 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.392927:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda800, rc 0) 00000100:00100000:2.0:1788869558.393020:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:12482:x1875765305120512:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 334us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.393028:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 230 00010000:00010000:2.0:1788869558.470177:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869558.598410:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325105280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869558.598508:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869558.599212:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325105280 00000100:00100000:2.0:1788869558.599224:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325105280 00000100:00100000:2.0:1788869558.599339:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788869558.599351:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325105280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869558.599409:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788869558.599498:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325105280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.599506:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788869558.599615:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325105280:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788869558.661853:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869558.661866:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869558.661897:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788869558.661906:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869558.662906:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325105408:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869558.663818:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869558.675360:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.677102:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305120640 00000100:00100000:0.0:1788869558.677119:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305120640 00000100:00100000:0.0:1788869558.677203:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:0.0:1788869558.677215:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12483:x1875765305120640:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869558.677253:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869558.677387:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12483:x1875765305120640:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 174us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.677406:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:3.0:1788869558.678375:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325105408:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869558.681196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869558.681345:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305120768 00000100:00100000:2.0:1788869558.681359:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305120768 00000100:00100000:2.0:1788869558.681451:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00100000:2.0:1788869558.681463:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:12483:x1875765305120768:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788869558.681570:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681642:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681656:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681675:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681683:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681689:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681714:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681724:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681731:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869558.681776:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788869558.681780:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869558.681794:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681807:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681825:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681832:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681838:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869558.681843:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681850:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681864:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:2.0:1788869558.681866:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869558.681871:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681877:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf825 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681891:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681897:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681902:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681906:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869558.681915:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681921:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681929:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8e280839ce00) 00010000:00010000:2.0:1788869558.681931:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869558.681934:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681940:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf82c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681957:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.681963:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.683754:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.683766:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869558.683771:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.683779:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.683794:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:2.0:1788869558.683797:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869558.683816:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.683823:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6cf833 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869558.683940:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:12483:x1875765305120768:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 2475us (2752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.684374:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00100000:2.0:1788869558.687432:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.688203:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305121024 00000100:00100000:0.0:1788869558.688216:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305121024 00000100:00100000:0.0:1788869558.688291:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:0.0:1788869558.688302:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+67:12483:x1875765305121024:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869558.688325:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869558.688349:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf83a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca0f9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688496:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688522:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688535:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869558.688563:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788869558.688682:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688690:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688697:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688703:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.688708:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688716:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688728:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.688731:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869558.688736:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688743:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf841 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688789:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf83a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f9 expref: 69 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688799:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:0.0:1788869558.688801:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869558.688812:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf83a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f9 expref: 69 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.688825:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a9600, rc 0) 00000100:00100000:0.0:1788869558.688893:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12483:x1875765305121024:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 593us (1477us total) trans 4294967506 rc 301/301 00000100:00100000:0.0:1788869558.688901:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:0.0:1788869558.694626:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.694959:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305121152 00000100:00100000:3.0:1788869558.694982:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305121152 00000100:00100000:3.0:1788869558.695047:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:3.0:1788869558.695060:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12483:x1875765305121152:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788869558.695102:0:8260:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788869558.695231:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12483:x1875765305121152:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 173us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.695239:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:2.0:1788869558.701455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.702137:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305121408 00000100:00100000:0.0:1788869558.702152:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305121408 00000100:00100000:0.0:1788869558.702220:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:0.0:1788869558.702231:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12483:x1875765305121408:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869558.702255:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869558.702258:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869558.702293:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9a00/0x4c16c38a9b6cf7df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0dd expref: 68 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.702314:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869558.702318:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869558.702333:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf84f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca100 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869558.702840:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788869558.702995:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf856 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.703009:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf856 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.703044:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf856 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.703104:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf84f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca100 expref: 70 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.703122:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf856 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca100 expref: 69 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.703131:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2809bdcd00) 00010000:00010000:0.0:1788869558.703134:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869558.703137:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8200, rc 0) 00000100:00100000:0.0:1788869558.703872:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+69:12483:x1875765305121408:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1638us (2425us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788869558.703882:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:1.0:1788869558.707565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.707783:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305121664 00000100:00100000:3.0:1788869558.707796:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305121664 00000100:00100000:2.0:1788869558.707996:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:2.0:1788869558.708009:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+69:12483:x1875765305121664:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869558.708079:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869558.708122:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf856 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca100 expref: 69 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708142:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e2809bdcd00) 00010000:00010000:2.0:1788869558.708154:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869558.708179:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708194:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708205:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708219:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708244:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708252:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708301:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708307:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708314:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708319:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869558.708324:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708330:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708338:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869558.708341:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869558.708345:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708351:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6cf864 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708362:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708373:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708378:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708382:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869558.708385:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708403:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708412:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x89163684 (ffff8e280839ce00) 00010000:00010000:2.0:1788869558.708414:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869558.708417:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.708422:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf86b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x89163684 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869558.708571:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12483:x1875765305121664:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 564us (1014us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869558.708579:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:2.0:1788869558.712376:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.712809:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305121792 00000100:00100000:3.0:1788869558.712820:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305121792 00000100:00100000:2.0:1788869558.712988:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:2.0:1788869558.712999:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+68:12483:x1875765305121792:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869558.713022:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869558.713068:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf872 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca107 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.713107:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.713134:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.713146:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.713266:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf872 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca107 expref: 70 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.713287:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca107 expref: 69 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.713297:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:2.0:1788869558.713300:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869558.713303:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edba00, rc 0) 00000100:00100000:2.0:1788869558.713371:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+69:12483:x1875765305121792:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 374us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.713377:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:3.0:1788869558.716150:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.716959:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305122048 00000100:00100000:0.0:1788869558.716979:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305122048 00000100:00100000:0.0:1788869558.717040:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:0.0:1788869558.717050:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+69:12483:x1875765305122048:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869558.717142:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.717164:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.717177:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869558.717401:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788869558.717414:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 492630826911ns, next at 493630823252ns, rc = 0 00000004:00010000:0.0:1788869558.717467:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ab64ea6 reply state 000000001e98115b transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.717734:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.717743:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:0.0:1788869558.717746:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788869558.717751:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869558.717856:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+71:12483:x1875765305122048:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 807us (1718us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788869558.717864:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:3.0:1788869558.720171:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.720321:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305122176 00000100:00100000:0.0:1788869558.720330:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305122176 00000100:00100000:0.0:1788869558.720404:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 239 00000100:00100000:0.0:1788869558.720413:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+71:12483:x1875765305122176:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869558.720439:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869558.720464:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca10e expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.720545:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca10e expref: 72 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.720560:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca10e expref: 72 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.720633:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:0.0:1788869558.720637:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869558.720641:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5800, rc 0) 00000100:00100000:0.0:1788869558.720702:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+72:12483:x1875765305122176:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 290us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.720709:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 239 00000100:00100000:3.0:1788869558.724009:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.724100:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305122304 00000100:00100000:0.0:1788869558.724113:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305122304 00000100:00100000:0.0:1788869558.724174:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:0.0:1788869558.724184:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2410:x1875765305122304:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788869558.724413:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:2410:x1875765305122304:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 231us (414us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788869558.724421:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:3.0:1788869558.727525:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.727620:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305122560 00000100:00100000:0.0:1788869558.727632:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305122560 00000100:00100000:0.0:1788869558.727688:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1788869558.727699:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+72:12483:x1875765305122560:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869558.727961:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+73:12483:x1875765305122560:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 262us (447us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1788869558.727968:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:3.0:1788869558.731296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.731417:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305122816 00000100:00100000:0.0:1788869558.731430:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305122816 00000100:00100000:0.0:1788869558.731510:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 240 00000100:00100000:0.0:1788869558.731522:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+73:12483:x1875765305122816:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788869558.731714:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+73:12483:x1875765305122816:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 194us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.731723:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 240 00000100:00100000:3.0:1788869558.735006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869558.735319:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305122944 00000100:00100000:2.0:1788869558.735332:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305122944 00000100:00100000:2.0:1788869558.735627:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 241 00000100:00100000:2.0:1788869558.735640:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+73:12483:x1875765305122944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869558.735664:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869558.735705:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf88e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca115 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.735801:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf895 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.735819:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.735832:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869558.735887:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869558.735909:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.735938:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6cf88e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca115 expref: 75 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.735957:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf895 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca115 expref: 74 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.735980:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:2.0:1788869558.735984:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788869558.735988:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edbc00, rc 0) 00000100:00100000:2.0:1788869558.736067:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+74:12483:x1875765305122944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 430us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.736075:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 241 00000100:00100000:1.0:1788869558.739361:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.739563:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305123072 00000100:00100000:3.0:1788869558.739577:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305123072 00000100:00100000:3.0:1788869558.739667:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:3.0:1788869558.739677:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+10:2409:x1875765305123072:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869558.739697:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869558.739720:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca11c expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869558.739746:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffbb5, blocks: 0x0 00010000:00010000:3.0:1788869558.739770:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1788869558.739775:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869558.739785:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca11c expref: 11 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.739804:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca11c expref: 11 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.739819:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8200, rc 0) 00000100:00100000:3.0:1788869558.739881:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:2409:x1875765305123072:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 205us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.739889:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:3.0:1788869558.743546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.743725:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305123328 00000100:00100000:0.0:1788869558.743737:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305123328 00000100:00100000:0.0:1788869558.743800:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 242 00000100:00100000:0.0:1788869558.743810:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+74:12483:x1875765305123328:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788869558.743932:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+74:12483:x1875765305123328:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 123us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.743939:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 242 00000100:00100000:3.0:1788869558.747854:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.747966:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305123456 00000100:00100000:0.0:1788869558.747991:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305123456 00000100:00100000:0.0:1788869558.748072:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1788869558.748083:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:12483:x1875765305123456:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869558.748114:0:8743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869558.748136:0:8743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca123 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.748171:0:8743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca11c expref: 12 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.748181:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869558.748185:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869558.748191:0:8743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 12 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.748257:0:8743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca11c expref: 12 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.748273:0:8743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca11c expref: 12 pid: 8443 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.748290:0:8743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8743:1875765325105536:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869558.748848:0:8743:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2810071480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869558.752554:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.752727:0:8743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8743:1875765325105536:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869558.752796:0:8743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 12 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.752819:0:8743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4800, rc 0) 00000100:00100000:0.0:1788869558.752884:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:12483:x1875765305123456:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4802us (5043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.752894:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1788869558.753001:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305123584 00000100:00100000:3.0:1788869558.753011:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305123584 00010000:00010000:3.0:1788869558.753047:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca11c expref: 12 pid: 8443 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.753104:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1788869558.753113:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:2410:x1875765305123584:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869558.753127:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869558.753151:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca11c expref: 12 pid: 8443 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.753164:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca11c expref: 12 pid: 8443 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.753189:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf89c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca11c expref: 12 pid: 8443 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.753203:0:10401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869558.753207:0:10401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869558.753215:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 11 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.753225:0:10401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 11 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.753260:0:10401:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 11 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.753276:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10401:1875765325105664:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788869558.753337:0:10401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869558.756879:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10401:1875765325105664:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788869558.756921:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869558.757002:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:2410:x1875765305123584:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3888us (4460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.757017:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:1.0:1788869558.761343:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.761442:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305123712 00000100:00100000:3.0:1788869558.761456:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305123712 00002000:00100000:3.0:1788869558.761523:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8e2703912300 x1875765305123712/t0(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:504/0 lens 504/0 e 0 to 0 dl 1788869569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869558.761536:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2703912300 with x1875765305123712 ext(0->12) 00002000:00010000:3.0:1788869558.761543:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2703912300 00000100:00100000:3.0:1788869558.761579:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788869558.761625:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+11:2407:x1875765305123712:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788869558.762862:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:2407:x1875765305123712:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 1263us (1519us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788869558.762875:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00002000:00100000:3.0:1788869558.762888:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8e2703912300 x1875765305123712/t4294967321(0) o4->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:504/0 lens 504/448 e 0 to 0 dl 1788869569 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869558.762898:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2703912300 with x1875765305123712 ext(0->12) 00002000:00010000:3.0:1788869558.762904:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2703912300 00000100:00100000:1.0:1788869558.765974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.766071:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305123840 00000100:00100000:0.0:1788869558.766084:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305123840 00000100:00100000:0.0:1788869558.766226:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 243 00000100:00100000:0.0:1788869558.766239:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+74:12483:x1875765305123840:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788869558.768159:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:1.0:1788869558.768184:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788869558.768223:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788869558.768244:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e27039520c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788869558.768248:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2806c37800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2703952780 00000020:00080000:1.0:1788869558.768252:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2806c37c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2704124800 00000004:00080000:1.0:1788869558.768279:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788869558.768333:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2840da1b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788869558.768337:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2804fb3100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2840da1780 00000020:00080000:1.0:1788869558.768340:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2804fb3f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2804f89c00 00000020:00080000:1.0:1788869558.768352:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1788869558.768505:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768518:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768526:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768532:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.768537:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768545:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768565:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e280839cd00) 00010000:00010000:0.0:1788869558.768568:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869558.768573:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768579:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cf5a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768636:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768643:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768661:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768667:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.768670:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768676:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768685:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e270365cc00) 00010000:00010000:0.0:1788869558.768688:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869558.768691:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768696:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6cf650 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768712:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768718:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768724:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768730:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.768733:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768755:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768764:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c900) 00010000:00010000:0.0:1788869558.768766:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869558.768769:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768774:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6cf6ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768787:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768793:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768798:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768802:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.768805:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768810:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768817:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e270365c900) 00010000:00010000:0.0:1788869558.768820:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869558.768822:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768835:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf6f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768851:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768856:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768861:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768866:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.768868:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768874:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768882:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.768884:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869558.768887:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768892:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6cf7c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768902:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768908:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768919:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768924:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.768927:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768933:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768942:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:0.0:1788869558.768944:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869558.768947:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.768952:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf880 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788869558.769183:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788869558.769276:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788869558.769303:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325105792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788869558.769775:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325106048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788869558.769825:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869558.769881:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869558.769888:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325105920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788869558.769911:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869558.769948:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325106048 00000100:00100000:3.0:1788869558.769957:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325106048 00000100:00100000:3.0:1788869558.770030:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325105920 00000100:00100000:3.0:1788869558.770034:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325105920 00000100:00100000:3.0:1788869558.770074:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869558.770084:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325106048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788869558.770114:0:8443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1788869558.770157:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ffbb4, atime: 0x0, ctime: 0x6a9ffbb4, blocks: 0x8 00010000:00010000:3.0:1788869558.770167:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770188:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1788869558.770193:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869558.770201:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770220:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770231:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770239:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770263:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869558.770446:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325106048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 362us (620us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788869558.770455:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869558.770488:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788869558.770496:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325105920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788869558.770626:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788869558.770630:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788869557 00002000:00010000:3.0:1788869558.770633:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788869558.770635:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788869557 -> 1788869557 00002000:00010000:3.0:1788869558.770637:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788869558.770665:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325105920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (752us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788869558.770671:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788869558.770689:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869558.770694:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788869558.770708:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869558.770717:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770727:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869558.770732:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770742:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770758:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770765:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.770802:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869558.770804:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869558.770806:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788869558.770839:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e282da8b800/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788869558.770846:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325105920:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788869558.770857:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2703910a80/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788869558.770861:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325106048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788869558.771194:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869558.771350:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:12483:x1875765305123840:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 5112us (5384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.771359:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 243 00000100:00100000:3.0:1788869558.771681:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325105792 00000100:00100000:3.0:1788869558.771690:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325105792 00000100:00100000:3.0:1788869558.771723:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788869558.771731:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325105792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788869558.771751:0:8743:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1788869558.771773:0:8743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.771794:0:8743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca07b expref: 12 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.771803:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788869558.771807:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869558.771812:0:8743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.771849:0:8743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca07b expref: 12 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.771882:0:8743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca07b expref: 12 pid: 8443 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.771898:0:8743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8743:1875765325106176:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869558.771955:0:8743:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869558.775912:0:8743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8743:1875765325106176:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869558.775945:0:8743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.776142:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869558.776853:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305123968 00000100:00100000:1.0:1788869558.776863:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305123968 00010000:00010000:1.0:1788869558.776907:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca07b expref: 13 pid: 8443 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869558.776952:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1788869558.776961:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+13:2410:x1875765305123968:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869558.776989:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869558.776995:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca07b expref: 13 pid: 8443 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.777039:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca07b expref: 13 pid: 8443 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.777065:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cf65e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca07b expref: 13 pid: 8443 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.777086:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869558.777090:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869558.777095:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.777105:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.777142:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869558.777205:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:2410:x1875765305123968:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 245us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869558.777214:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00010000:00010000:3.0:1788869558.778523:0:8743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.778543:0:8743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.778555:0:8743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.778564:0:8743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.778583:0:8743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869558.778860:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1875765325105792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7127us (7664us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788869558.778871:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869558.779002:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000004:00080000:2.0:1788869558.779086:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e282da8ad80/2, rc 0, transno 4294967323 00000100:00100000:2.0:1788869558.779119:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325105792:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788869558.779669:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869558.779682:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.779693:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869558.779698:0:7475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.779724:0:7475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.779748:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.779756:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cf8b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.779784:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869558.779786:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869558.779788:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869558.779861:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305124096 00000100:00100000:3.0:1788869558.779873:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305124096 00000100:00100000:3.0:1788869558.779929:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1788869558.779946:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+12:2410:x1875765305124096:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788869558.782507:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788869558.782525:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1788869558.782933:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305124096:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 2981us (3925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869558.782944:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788869558.787988:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.788080:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305124352 00000100:00100000:0.0:1788869558.788092:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305124352 00000100:00100000:0.0:1788869558.788161:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:0.0:1788869558.788172:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:12483:x1875765305124352:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869558.788250:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869558.788279:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cf895 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca115 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.788308:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:0.0:1788869558.788314:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869558.788355:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.788371:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.788397:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869558.788552:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078725316 reply state 00000000e346fc9f transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.788565:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.788572:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:0.0:1788869558.788574:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869558.788577:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869558.788716:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:12483:x1875765305124352:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 544us (746us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1788869558.788723:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:3.0:1788869558.794279:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869558.794425:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305124480 00000100:00100000:1.0:1788869558.794440:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305124480 00000100:00100000:1.0:1788869558.794519:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1788869558.794531:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2409:x1875765305124480:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788869558.794737:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788869558.794741:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788869557 -> 1788869557 00002000:00010000:1.0:1788869558.794743:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788869556 00002000:00010000:1.0:1788869558.794745:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788869557 -> 1788869557 00002000:00010000:1.0:1788869558.794748:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788869558.794825:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2409:x1875765305124480:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 297us (558us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788869558.794833:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:2.0:1788869558.799409:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869558.799616:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305124736 00000100:00100000:1.0:1788869558.799639:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305124736 00000100:00100000:1.0:1788869558.799758:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 245 00000100:00100000:1.0:1788869558.799770:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:12483:x1875765305124736:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788869558.799851:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.799871:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca107 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.799881:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.799925:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca107 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.799941:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca107 expref: 22 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869558.799958:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325106304:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869558.800071:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869558.804553:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875765325106304:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869558.804637:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869558.807530:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.808164:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305124864 00000100:00100000:3.0:1788869558.808177:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305124864 00010000:00010000:3.0:1788869558.808228:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca107 expref: 23 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.808280:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:3.0:1788869558.808292:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:2409:x1875765305124864:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869558.808312:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869558.808320:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca107 expref: 23 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.808334:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca107 expref: 23 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.808357:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cf879 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca107 expref: 23 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.808375:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:3.0:1788869558.808380:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.808399:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.808427:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.808454:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869558.808545:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:2409:x1875765305124864:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 255us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.808554:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00010000:00010000:1.0:1788869558.808862:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.808871:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.808914:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.808921:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.808928:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.808934:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869558.808938:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.808946:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.808957:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:1.0:1788869558.808959:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788869558.808963:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.808968:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6cf8bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869558.809015:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:12483:x1875765305124736:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 9248us (9616us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788869558.809031:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 245 00000100:00100000:2.0:1788869558.812891:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.813022:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305124992 00000100:00100000:3.0:1788869558.813035:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305124992 00000100:00100000:3.0:1788869558.813100:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:3.0:1788869558.813111:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2410:x1875765305124992:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788869558.813385:0:8743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.813422:0:8743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 8 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.813432:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869558.813437:0:8743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869558.813442:0:8743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.813483:0:8743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 8 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.813499:0:8743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 8 pid: 8743 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.813531:0:8743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8743:1875765325106432:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869558.814995:0:8743:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869558.820356:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.821015:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305125120 00000100:00100000:0.0:1788869558.821028:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305125120 00010000:00010000:0.0:1788869558.821074:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 9 pid: 8743 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.821147:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:0.0:1788869558.821158:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2409:x1875765305125120:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869558.821179:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869558.821204:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 9 pid: 8743 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.821218:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 9 pid: 8743 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.821244:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869558.821248:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869558.821254:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.821264:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.821284:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869558.821345:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+9:2409:x1875765305125120:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 189us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.821353:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 104 00010000:00010000:1.0:1788869558.822861:0:8743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cf8a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca123 expref: 8 pid: 8743 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869558.822888:0:8743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8743:1875765325106432:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869558.822914:0:8743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.822927:0:8743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.822934:0:8743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.823087:0:8743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.823097:0:8743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.823107:0:8743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.823270:0:8743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869558.823275:0:8743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.823310:0:8743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.823334:0:8743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.823341:0:8743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cf8c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869558.823529:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305124992:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 10419us (10652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869558.823540:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:2.0:1788869558.827331:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.827450:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305125376 00000100:00100000:0.0:1788869558.827466:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305125376 00000100:00100000:0.0:1788869558.827753:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 246 00000100:00100000:0.0:1788869558.827769:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:12483:x1875765305125376:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788869558.827893:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.827915:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0cf expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.827925:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.827961:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0cf expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.828086:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0cf expref: 21 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.828103:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325106560:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869558.828317:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28100713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869558.830744:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325106560:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869558.830801:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869558.834856:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869558.835240:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305125504 00000100:00100000:3.0:1788869558.835255:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305125504 00010000:00010000:3.0:1788869558.835306:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0cf expref: 22 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.835416:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1788869558.835428:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:2409:x1875765305125504:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869558.835448:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869558.835457:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0cf expref: 22 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.835482:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0cf expref: 22 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.835514:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8000/0x4c16c38a9b6cf7bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0cf expref: 22 pid: 6526 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.835532:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:3.0:1788869558.835539:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f2 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.835549:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.835578:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.835803:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.835908:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869558.836065:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.836074:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.836310:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.836327:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca10e expref: 22 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.836337:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.836375:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca10e expref: 22 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.836401:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca10e expref: 22 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.836418:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325106688:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869558.836515:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869558.841194:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:2409:x1875765305125504:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 5738us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.841218:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:0.0:1788869558.843913:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869558.844238:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305125632 00000100:00100000:1.0:1788869558.844251:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305125632 00010000:00010000:1.0:1788869558.844301:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca10e expref: 22 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869558.844342:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:1.0:1788869558.844350:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:2409:x1875765305125632:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869558.844364:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869558.844371:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca10e expref: 22 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.844384:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca10e expref: 22 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.844438:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:1.0:1788869558.844444:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.844454:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.844463:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.844494:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869558.844557:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:2409:x1875765305125632:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 206us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869558.844565:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00010000:00010000:3.0:1788869558.847807:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf887 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca10e expref: 21 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.847838:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325106688:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869558.847866:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.848089:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.848098:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869558.848328:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1788869558.848584:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1788869558.848802:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1788869558.848899:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325106816:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788869558.849133:0:8260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869558.849317:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2810071540 going to sleep for 11 seconds 00000100:00100000:2.0:1788869558.849376:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325106816 00000100:00100000:2.0:1788869558.849397:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325106816 00000100:00100000:2.0:1788869558.849517:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788869558.849530:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8260:x1875765325106816:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788869558.849826:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8260:x1875765325106816:12345-0@lo:1000:mdt00_003.0 Request processed in 299us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.849833:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788869558.849895:0:8260:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1788869558.849902:0:8260:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:0.0:1788869558.849921:0:8260:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e282da8b800, transno 4294967322 00000004:00080000:0.0:1788869558.849943:0:8260:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e282da8ad80, transno 4294967323 00000100:00100000:0.0:1788869558.849950:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325106816:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788869558.850113:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1788869558.850198:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325106944:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788869558.850234:0:8260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869558.851199:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2810071300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869558.851335:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325106944 00000100:00100000:1.0:1788869558.851343:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325106944 00000100:00100000:1.0:1788869558.851383:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788869558.851402:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8260:x1875765325106944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788869558.851650:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8260:x1875765325106944:12345-0@lo:1000:mdt00_003.0 Request processed in 248us (1414us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788869558.851659:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788869558.851961:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8260:1875765325106944:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788869558.852218:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852230:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852239:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852246:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.852251:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852260:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852301:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:0.0:1788869558.852304:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869558.852310:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852316:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6cf8d4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852345:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852351:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852356:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852361:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.852363:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852369:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852377:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.852379:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869558.852398:0:8260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f2 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852411:0:8260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f2 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852427:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f2 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.852539:0:8260:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f2 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.852557:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325107072:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788869558.852699:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869558.858160:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869558.858295:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305125760 00000100:00100000:1.0:1788869558.858306:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305125760 00000100:00100000:1.0:1788869558.858373:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1788869558.858395:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:12482:x1875765305125760:12345-192.168.204.54@tcp:49:lfs.0 00000100:00100000:1.0:1788869558.858568:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:12482:x1875765305125760:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 184us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869558.858628:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788869558.861929:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.862188:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305126016 00000100:00100000:0.0:1788869558.862201:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305126016 00000100:00100000:0.0:1788869558.862264:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:0.0:1788869558.862276:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:12482:x1875765305126016:12345-192.168.204.54@tcp:58:lfs.0 00000040:00080000:0.0:1788869558.862731:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788869558.862824:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:12482:x1875765305126016:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 550us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.862833:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:2.0:1788869558.865457:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325107072:192.168.204.54@tcp:105: 00010000:00010000:2.0:1788869558.868305:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868329:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf817 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868377:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868427:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868442:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868455:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868461:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868468:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868484:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869558.868487:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868493:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868505:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:2.0:1788869558.868508:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869558.868512:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868518:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8db lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868530:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868542:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868548:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868553:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869558.868556:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868562:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868569:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:2.0:1788869558.868572:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869558.868575:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.868581:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf8cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869558.868798:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+24:12483:x1875765305125376:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 41030us (41475us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788869558.868814:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 246 00000020:00080000:2.0:1788869558.868821:0:8260:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788869558.869448:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869558.869456:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869558.869492:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788869558.869502:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869558.869706:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325107200:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869558.869784:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788869558.883014:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.883176:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305126272 00000100:00100000:0.0:1788869558.883188:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305126272 00000100:00100000:0.0:1788869558.883253:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1788869558.883263:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282a61c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+25:12483:x1875765305126272:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788869558.883565:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788869558.883651:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:0.0:1788869558.883687:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.883729:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.883743:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.883752:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.883758:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.883764:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.883785:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788869558.883900:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282a61c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+27:12483:x1875765305126272:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 636us (897us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788869558.883909:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000020:00080000:0.0:1788869558.883914:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788869558.883981:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869558.883988:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.883998:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869558.884003:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.884012:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.884041:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:0.0:1788869558.884045:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788869558.884053:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.884059:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.884077:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869558.884080:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869558.884081:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869558.884649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.886265:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305126400 00000100:00100000:0.0:1788869558.886283:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305126400 00000100:00100000:0.0:1788869558.886348:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 248 00000100:00100000:0.0:1788869558.886359:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+27:12484:x1875765305126400:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869558.886404:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869558.886567:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+27:12484:x1875765305126400:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 209us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.886577:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 248 00000100:00100000:3.0:1788869558.888472:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875765325107200:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869558.893369:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869558.893544:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305126656 00000100:00100000:2.0:1788869558.893555:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305126656 00000100:00100000:2.0:1788869558.893656:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 249 00000100:00100000:2.0:1788869558.893668:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+26:12484:x1875765305126656:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869558.893717:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869558.893743:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca12a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.893882:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf8f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.893901:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.893914:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869558.893924:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788869558.894049:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6cf8e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca12a expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.894070:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca12a expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.894078:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:2.0:1788869558.894081:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788869558.894086:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb800, rc 0) 00000100:00100000:2.0:1788869558.896103:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+28:12484:x1875765305126656:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2423us (2733us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788869558.896117:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 249 00000100:00100000:2.0:1788869558.902716:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.902798:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305126912 00000100:00100000:0.0:1788869558.902810:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305126912 00000100:00100000:0.0:1788869558.902875:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 250 00000100:00100000:0.0:1788869558.902887:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+28:12484:x1875765305126912:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788869558.902975:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.902994:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.903021:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.903279:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.903287:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.903293:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.903300:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869558.903305:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.903313:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.903328:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.903332:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869558.903337:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.903343:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6cf8fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.903496:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+29:12484:x1875765305126912:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 610us (793us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788869558.903506:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 250 00000040:00080000:3.0:1788869558.904250:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869558.904256:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869558.904763:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788869558.904772:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869558.909971:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.910321:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305127168 00000100:00100000:0.0:1788869558.910336:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305127168 00000100:00100000:0.0:1788869558.910410:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1788869558.910422:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+29:12484:x1875765305127168:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869558.911569:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:12484:x1875765305127168:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1142us (1606us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788869558.911581:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1788869558.914196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.914243:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305127296 00000100:00100000:0.0:1788869558.914255:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305127296 00000100:00100000:0.0:1788869558.914314:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 251 00000100:00100000:0.0:1788869558.914325:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+30:12486:x1875765305127296:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869558.914345:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869558.914369:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf905 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca131 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914468:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914483:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914494:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914511:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914519:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914549:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914660:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914672:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0eb expref: 31 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914690:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914722:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0eb expref: 31 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.914737:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0eb expref: 31 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.914751:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325107328:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869558.914818:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869558.920809:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.920984:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1875765325107328:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869558.921011:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869558.921131:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305127552 00000100:00100000:3.0:1788869558.921151:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305127552 00000100:00100000:3.0:1788869558.921221:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788869558.921232:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+32:6179:x1875765305127552:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788869558.921501:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:6179:x1875765305127552:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 270us (708us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788869558.921509:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1788869558.924888:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869558.924990:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305127680 00000100:00100000:0.0:1788869558.925002:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305127680 00010000:00010000:0.0:1788869558.925042:0:10401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0eb expref: 33 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.925105:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:0.0:1788869558.925116:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:2409:x1875765305127680:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869558.925133:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869558.925149:0:10401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0eb expref: 33 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.925162:0:10401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0eb expref: 33 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.925184:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6cf809 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0eb expref: 33 pid: 8260 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.925200:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869558.925206:0:10401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.925216:0:10401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.925223:0:10401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869558.925258:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869558.925314:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.925315:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+32:2409:x1875765305127680:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 201us (436us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869558.925323:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869558.925323:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000004:00200000:1.0:1788869558.925378:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788869558.925393:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869558.925417:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925433:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925442:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925449:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925456:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925462:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869558.925466:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925485:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925496:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:1.0:1788869558.925499:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869558.925504:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925509:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4400/0x4c16c38a9b6cf90c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925521:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925527:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925534:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925539:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869558.925542:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925548:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925555:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e2809bdc700) 00010000:00010000:1.0:1788869558.925557:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869558.925559:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925574:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf913 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925649:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6cf905 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca131 expref: 32 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925665:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca131 expref: 31 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869558.925672:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:1.0:1788869558.925686:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869558.925688:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8600, rc 0) 00000100:00100000:1.0:1788869558.925729:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+31:12486:x1875765305127296:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 11407us (11544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869558.925737:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 251 00010000:00010000:3.0:1788869559.493803:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869559.622784:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869559.622811:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325107456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869559.622888:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869559.623120:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325107456 00000100:00100000:3.0:1788869559.623129:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325107456 00000100:00100000:3.0:1788869559.623191:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788869559.623202:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875765325107456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869559.623232:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788869559.623285:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875765325107456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869559.623292:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788869559.623381:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325107584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869559.623409:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869559.623466:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325107456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869559.623524:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325107584 00000100:00100000:3.0:1788869559.623528:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325107584 00000100:00100000:3.0:1788869559.623566:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869559.623572:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325107584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869559.623583:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788869559.623638:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325107584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869559.623645:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869559.623673:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325107584:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788869559.623790:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788869559.830826:0:14716:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869559.830841:0:14716:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869559.830875:0:14716:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788869559.830885:0:14716:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869560.069999:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869560.070313:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305127936 00000100:00100000:0.0:1788869560.070335:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305127936 00000100:00100000:0.0:1788869560.070422:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00100000:0.0:1788869560.070435:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+31:12509:x1875765305127936:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869560.070467:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869560.070491:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf921 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca138 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.070631:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf928 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.070647:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf928 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.070659:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf928 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869560.070671:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788869560.070786:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf921 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca138 expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.070806:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf928 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca138 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.070814:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869560.070817:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788869560.070821:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8200, rc 0) 00000100:00100000:0.0:1788869560.070891:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:12509:x1875765305127936:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 459us (900us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788869560.070900:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00080000:2.0:1788869560.071700:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869560.074218:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869560.074330:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305128064 00000100:00100000:0.0:1788869560.074341:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305128064 00000100:00100000:0.0:1788869560.074406:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 253 00000100:00100000:0.0:1788869560.074416:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:12509:x1875765305128064:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1788869560.074488:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.074510:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.074523:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.074564:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.074571:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.074579:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.074604:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869560.074609:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.074617:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.074629:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:0.0:1788869560.074632:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869560.074638:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869560.074657:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf936 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869560.074728:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:12509:x1875765305128064:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 313us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869560.074735:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 253 00000100:00100000:3.0:1788869560.187122:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869560.187397:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305128192 00000100:00100000:1.0:1788869560.187411:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305128192 00000100:00100000:1.0:1788869560.187673:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1788869560.187686:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2409:x1875765305128192:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1788869560.187724:0:11338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869560.187750:0:11338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cf93d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca13f expref: -99 pid: 11338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869560.187780:0:11338:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ffbb5, atime: 0x6a9ffbb4, ctime: 0x6a9ffbb5, blocks: 0x8 00010000:00010000:1.0:1788869560.187805:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788869560.187809:0:11338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869560.187820:0:11338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cf93d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca13f expref: 8 pid: 11338 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869560.187843:0:11338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cf93d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca13f expref: 8 pid: 11338 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869560.187857:0:11338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ea00, rc 0) 00000100:00100000:1.0:1788869560.187926:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2409:x1875765305128192:12345-192.168.204.54@tcp:101:cat.0 Request processed in 243us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869560.187934:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00080000:2.0:1788869560.192180:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869560.200085:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869560.200217:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305128320 00000100:00100000:2.0:1788869560.200229:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305128320 00002000:00100000:2.0:1788869560.200289:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8e27039f3b80 x1875765305128320/t0(0) o3->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:506/0 lens 488/0 e 0 to 0 dl 1788869571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869560.200302:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e27039f3b80 with x1875765305128320 ext(0->4095) 00002000:00010000:2.0:1788869560.200308:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e27039f3b80 00000100:00100000:2.0:1788869560.200348:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788869560.200525:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2407:x1875765305128320:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:2.0:1788869560.200781:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2407:x1875765305128320:12345-192.168.204.54@tcp:3:cat.0 Request processed in 423us (708us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788869560.200789:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00002000:00100000:2.0:1788869560.200796:0:8448:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8e27039f3b80 x1875765305128320/t0(0) o3->91cba2f3-33fb-476e-a4a1-b4fbee1b176d@192.168.204.54@tcp:506/0 lens 488/4536 e 0 to 0 dl 1788869571 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869560.200804:0:8448:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e27039f3b80 with x1875765305128320 ext(0->4095) 00002000:00010000:2.0:1788869560.200808:0:8448:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e27039f3b80 00010000:00010000:1.0:1788869560.518047:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869560.646120:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869560.646146:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325107712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869560.646223:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869560.646476:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325107712 00000100:00100000:2.0:1788869560.646485:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325107712 00000100:00100000:2.0:1788869560.646548:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788869560.646559:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325107712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869560.646619:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869560.646678:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325107712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869560.646685:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788869560.647072:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325107712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869560.768203:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869560.768244:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305128448 00000100:00100000:0.0:1788869560.768249:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869560.768269:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305128448 00000100:00100000:0.0:1788869560.768288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869560.768327:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869560.768332:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 400 00000100:00100000:3.0:1788869560.768344:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2407:x1875765305128448:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869560.768358:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869560.768379:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869560.768398:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869560.768422:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305128704 00000100:00100000:0.0:1788869560.768426:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305128704 00000100:00100000:3.0:1788869560.768453:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2407:x1875765305128448:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 100us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869560.768461:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305129216 00000100:00100000:3.0:1788869560.768462:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 400 00000100:00100000:0.0:1788869560.768464:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305129216 00000100:00100000:0.0:1788869560.768478:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305128576 00000100:00100000:0.0:1788869560.768480:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305128576 00000100:00100000:0.0:1788869560.768490:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305129088 00000100:00100000:0.0:1788869560.768492:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305129088 00000100:00100000:0.0:1788869560.768509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 373 00000100:00100000:0.0:1788869560.768516:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305128704:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869560.768551:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305128704:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869560.768558:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 373 00000100:00100000:0.0:1788869560.768569:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 374 00000100:00100000:0.0:1788869560.768582:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305129216:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869560.768643:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 375 00000100:00100000:3.0:1788869560.768652:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:2407:x1875765305128576:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869560.768661:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305128960 00000100:00100000:1.0:1788869560.768676:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305128960 00000100:00100000:3.0:1788869560.768685:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+33:2407:x1875765305128576:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869560.768692:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 375 00000100:00100000:1.0:1788869560.768704:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305128832 00000100:00100000:3.0:1788869560.768706:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 376 00000100:00100000:1.0:1788869560.768706:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305128832 00000100:00100000:3.0:1788869560.768712:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305129088:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869560.768722:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:1.0:1788869560.768729:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305128960:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869560.768735:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305129088:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869560.768742:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 376 00000100:00100000:1.0:1788869560.768762:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2407:x1875765305128960:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869560.768770:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:1.0:1788869560.768812:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:1.0:1788869560.768819:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2407:x1875765305128832:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:3.0:1788869560.768928:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869560.768932:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869560.768934:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869560.768957:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc71e56-b348-418d-8d54-3ebb3639d490+5:2407:x1875765305129216:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 375us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869560.768963:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 374 00000100:00100000:1.0:1788869560.769296:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+8:2407:x1875765305128832:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 476us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869560.769304:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 179 00010000:00010000:0.0:1788869561.556705:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869561.671243:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325107968:0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.671324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869561.671389:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325108480:0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.671410:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869561.671434:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325108992:0@lo:400:kworker.0 00000100:00100000:3.0:1788869561.671564:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325108096:0@lo:400:kworker.0 00000100:00100000:3.0:1788869561.671625:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869561.671645:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325108608:0@lo:400:kworker.0 00000100:00100000:3.0:1788869561.671677:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325107968 00000100:00100000:3.0:1788869561.671694:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325107968 00000100:00100000:3.0:1788869561.671742:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325108480 00000100:00100000:3.0:1788869561.671752:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325108480 00000100:00100000:3.0:1788869561.671865:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788869561.671874:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325107968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869561.671923:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325107968:12345-0@lo:400:kworker.0 Request processed in 51us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869561.671931:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788869561.671948:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788869561.671954:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325108480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869561.671981:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325108480:12345-0@lo:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869561.671987:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:3.0:1788869561.672007:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869561.672103:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325107840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.672136:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869561.672159:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325108352:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.672182:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869561.672201:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325108864:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.672224:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869561.672242:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325109376:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.672258:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869561.672275:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788869561.672280:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325108224:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.672313:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325107840 00000100:00100000:0.0:1788869561.672316:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325107840 00000100:00100000:0.0:1788869561.672357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788869561.672364:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325107840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.672397:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325107840:12345-0@lo:400:kworker.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869561.672403:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788869561.672428:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325108864 00000100:00100000:0.0:1788869561.672431:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325108864 00000100:00100000:0.0:1788869561.672613:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325109376 00000100:00100000:0.0:1788869561.672623:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325109376 00000100:00100000:0.0:1788869561.672651:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788869561.672657:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325108864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.672687:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325108864:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869561.672693:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788869561.672716:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788869561.672722:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325109376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.672748:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325109376:12345-0@lo:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869561.672753:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788869561.673606:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869561.673934:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869561.673940:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869561.673952:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869561.673989:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325108736:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.674033:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869561.674052:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325109248:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.674073:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869561.674095:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325107840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.674112:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325108864:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.674122:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325109376:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.674152:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325108736 00000100:00100000:0.0:1788869561.674157:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325108736 00000100:00100000:0.0:1788869561.674192:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325109248 00000100:00100000:0.0:1788869561.674195:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325109248 00000100:00100000:0.0:1788869561.674212:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788869561.674226:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325108736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.674264:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325108736:12345-0@lo:400:kworker.0 Request processed in 40us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869561.674271:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788869561.674284:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788869561.674289:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325109248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.674311:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325109248:12345-0@lo:400:kworker.0 Request processed in 22us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869561.674316:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:0.0:1788869561.674343:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869561.674345:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869561.674366:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325108736:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.674375:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325109248:0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.674523:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325107968:0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.674543:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325108480:0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.674566:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325108992 00000100:00100000:2.0:1788869561.674570:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325108992 00000100:00080000:1.0:1788869561.674613:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869561.674643:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325108224 00000100:00100000:2.0:1788869561.674647:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325108224 00000100:00100000:2.0:1788869561.674662:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788869561.674667:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325108992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.674724:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325108992:12345-0@lo:400:kworker.0 Request processed in 57us (3269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869561.674731:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788869561.674743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788869561.674749:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325108224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869561.675677:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325108096 00000100:00100000:3.0:1788869561.675698:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325108096 00000100:00100000:3.0:1788869561.675736:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325108352 00000100:00100000:3.0:1788869561.675739:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325108352 00000100:00100000:3.0:1788869561.675757:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788869561.675764:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325108096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869561.675906:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325108096:12345-0@lo:400:kworker.0 Request processed in 142us (4280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869561.675914:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788869561.675929:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788869561.675935:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325108352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.676012:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325108224:12345-0@lo:400:kworker.0 Request processed in 1261us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869561.676020:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788869561.676045:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869561.676081:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325109120:0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.676117:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869561.676160:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325108096:0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.676195:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325108608 00000100:00100000:2.0:1788869561.676199:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325108608 00000100:00100000:2.0:1788869561.676230:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325109120 00000100:00100000:2.0:1788869561.676233:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325109120 00000100:00100000:2.0:1788869561.676249:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788869561.676255:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325108608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.676291:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325108608:12345-0@lo:400:kworker.0 Request processed in 36us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869561.676297:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788869561.676309:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788869561.676315:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325109120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.676352:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325109120:12345-0@lo:400:kworker.0 Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869561.676357:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00080000:2.0:1788869561.676372:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788869561.676393:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2841000a80 x1875765325108608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869561.676403:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325108608:0@lo:400:kworker.0 00010000:00080000:2.0:1788869561.676412:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2841003b80 x1875765325109120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869561.676420:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325109120:0@lo:400:kworker.0 00000100:00100000:0.0:1788869561.678670:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325108992:0@lo:400:kworker.0 00000100:00100000:3.0:1788869561.680668:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325108352:12345-0@lo:400:kworker.0 Request processed in 4719us (8471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869561.680694:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788869561.685900:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325108224:0@lo:400:kworker.0 00000100:00100000:2.0:1788869561.685934:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325108352:0@lo:400:kworker.0 00000100:00100000:2.0:1788869562.182876:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325109504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869562.182977:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869562.183042:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869562.183049:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325109632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869562.183072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869562.183115:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325109504 00000100:00100000:2.0:1788869562.183124:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325109504 00000100:00100000:2.0:1788869562.183169:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325109632 00000100:00100000:2.0:1788869562.183172:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325109632 00000100:00100000:2.0:1788869562.183189:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788869562.183198:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325109504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869562.183230:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869562.183278:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325109504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869562.183285:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788869562.183385:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788869562.183393:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875765325109632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869562.183404:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869562.183428:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875765325109632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869562.183433:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788869562.183476:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325109632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869562.183490:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325109504:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869562.565961:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869562.567831:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788869563.013857:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869563.013870:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869563.013967:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788869563.013977:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788869563.589762:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869563.717888:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325109760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869563.717972:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869563.718226:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325109760 00000100:00100000:3.0:1788869563.718235:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325109760 00000100:00100000:3.0:1788869563.718305:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788869563.718316:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325109760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869563.718359:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788869563.718420:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325109760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869563.718428:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788869563.718537:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325109760:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1788869564.236258:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788869564.236321:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e2810071540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788869564.236327:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2703a7dd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e2810071240 00000020:00080000:1.0:1788869564.236331:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e2703a7d100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2703bca800 00000020:00080000:1.0:1788869564.236382:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788869564.236729:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788869564.236812:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788869564.237249:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869564.237263:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869564.237363:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869564.237370:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869564.237375:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869564.237383:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869564.237403:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e280839c900) 00010000:00010000:0.0:1788869564.237406:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869564.237412:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869564.237418:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6cf8b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869564.237856:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:0.0:1788869564.613820:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869564.745631:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869564.745661:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325109888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869564.745742:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869564.745815:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325109888 00000100:00100000:3.0:1788869564.745824:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325109888 00000100:00100000:3.0:1788869564.745881:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788869564.745890:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765325109888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869564.745921:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788869564.745970:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765325109888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869564.745978:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1788869564.746002:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869564.746045:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325109888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869564.746243:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325110016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869564.746281:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869564.746365:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325110016 00000100:00100000:0.0:1788869564.746370:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325110016 00000100:00100000:0.0:1788869564.746411:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788869564.746418:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325110016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869564.746429:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788869564.746466:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325110016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869564.746471:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788869564.746500:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325110016:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788869564.746641:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788869565.257649:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788869565.257666:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:3.0:1788869565.633824:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869565.634473:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305129344 00000100:00100000:2.0:1788869565.634488:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305129344 00000100:00100000:2.0:1788869565.634682:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:2.0:1788869565.634693:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:12170:x1875765305129344:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788869565.634820:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:12170:x1875765305129344:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 130us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869565.634829:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00080000:3.0:1788869565.637143:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869565.642724:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869565.648996:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305129472 00000100:00100000:0.0:1788869565.649077:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305129472 00000100:00100000:2.0:1788869565.649232:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00100000:2.0:1788869565.649248:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:12170:x1875765305129472:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788869565.649379:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:12170:x1875765305129472:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 137us (6665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869565.649386:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00080000:3.0:1788869565.649577:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788869565.654211:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869565.659403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869565.659632:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305129728 00000100:00100000:0.0:1788869565.660120:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305129728 00000100:00100000:1.0:1788869565.660264:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788869565.660276:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:12170:x1875765305129728:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788869565.660556:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:12170:x1875765305129728:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 282us (1165us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788869565.660564:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788869565.767549:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325110144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869565.767715:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869565.767964:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325110144 00000100:00100000:3.0:1788869565.767973:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325110144 00000100:00100000:3.0:1788869565.768047:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788869565.768056:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325110144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869565.768103:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869565.768168:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325110144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869565.768176:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788869565.768578:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325110144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869565.882313:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869565.886115:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305129984 00000100:00100000:0.0:1788869565.886137:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305129984 00000100:00100000:0.0:1788869565.886347:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:0.0:1788869565.886359:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305129984:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869565.886469:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2410:x1875765305129984:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 112us (4168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869565.886477:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00080000:3.0:1788869565.891399:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869565.894872:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869565.895192:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869565.895227:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869565.895272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869565.895334:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305130112 00000100:00100000:0.0:1788869565.895347:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305130112 00000100:00100000:0.0:1788869565.895425:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:0.0:1788869565.895438:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305130112:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869565.895522:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2410:x1875765305130112:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869565.895529:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:3.0:1788869565.896567:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305129856 00000100:00100000:3.0:1788869565.896582:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305129856 00000100:00100000:3.0:1788869565.896668:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 402 00000100:00100000:3.0:1788869565.896678:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305129856:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869565.896727:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+13:2410:x1875765305129856:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 51us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869565.896733:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 402 00000100:00080000:3.0:1788869565.896764:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869565.908748:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305130240 00000100:00100000:1.0:1788869565.908765:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305130240 00000100:00100000:1.0:1788869565.908852:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305130368 00000100:00100000:1.0:1788869565.908856:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305130368 00000100:00100000:1.0:1788869565.908897:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 383 00000100:00100000:1.0:1788869565.908907:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305130240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869565.909014:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305130240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 109us (14156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869565.909021:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 383 00000100:00100000:1.0:1788869565.909056:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 384 00000100:00100000:1.0:1788869565.909063:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305130368:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869565.909087:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2410:x1875765305130368:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (13815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869565.909093:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 384 00000100:00080000:3.0:1788869565.911412:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869565.911424:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788869566.664203:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869566.790015:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869566.790041:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325110528:0@lo:400:kworker.0 00000100:00100000:2.0:1788869566.790130:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869566.790197:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325110528 00000100:00100000:0.0:1788869566.790209:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325110528 00000100:00100000:2.0:1788869566.790217:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325110656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869566.790256:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869566.790280:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788869566.790289:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325110528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869566.790322:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869566.790330:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325111040:0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.790346:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325110528:12345-0@lo:400:kworker.0 Request processed in 58us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869566.790351:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869566.790353:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788869566.790379:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325110528:0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.790523:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325111552:0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.790552:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869566.790574:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788869566.790579:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325111168:0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.790641:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869566.790658:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325111680:0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.790675:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869566.790716:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325111168 00000100:00100000:0.0:1788869566.790720:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325111168 00000100:00100000:0.0:1788869566.790754:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325111680 00000100:00100000:0.0:1788869566.790757:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325111680 00000100:00100000:0.0:1788869566.790778:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788869566.790796:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325111168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.790843:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325111168:12345-0@lo:400:kworker.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.790850:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788869566.790863:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788869566.790869:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325111680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869566.790894:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325110656 00000100:00100000:2.0:1788869566.790897:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325110656 00000100:00100000:0.0:1788869566.790897:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325111680:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.790902:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788869566.790923:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325111040 00000100:00100000:2.0:1788869566.790925:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325111040 00000100:00100000:0.0:1788869566.790927:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325111168:0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.790936:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325111680:0@lo:400:kworker.0 00000100:00100000:2.0:1788869566.790938:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325111552 00000100:00100000:2.0:1788869566.790940:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325111552 00000100:00100000:2.0:1788869566.790953:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788869566.790959:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325110656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.790962:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788869566.790968:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325111040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869566.790991:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325110656:12345-0@lo:400:kworker.0 Request processed in 32us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869566.790997:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788869566.791010:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788869566.791015:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325111552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.791019:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325111040:12345-0@lo:400:kworker.0 Request processed in 51us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.791025:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788869566.791042:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325111552:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869566.791048:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00010000:00080000:0.0:1788869566.791051:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703ba8000 x1875765325111552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869566.791062:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325111552:0@lo:400:kworker.0 00010000:00080000:2.0:1788869566.791068:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703ba8e00 x1875765325111040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869566.791077:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325111040:0@lo:400:kworker.0 00000100:00100000:2.0:1788869566.791088:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325110656:0@lo:400:kworker.0 00000100:00100000:3.0:1788869566.791161:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325110272:0@lo:400:kworker.0 00000100:00100000:3.0:1788869566.791200:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869566.791240:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325110784:0@lo:400:kworker.0 00000100:00100000:3.0:1788869566.791265:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869566.791281:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325111296:0@lo:400:kworker.0 00000100:00100000:1.0:1788869566.791413:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325110400:0@lo:400:kworker.0 00000100:00100000:1.0:1788869566.791441:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869566.791458:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325110912:0@lo:400:kworker.0 00000100:00100000:1.0:1788869566.791477:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869566.791490:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325110400 00000100:00100000:1.0:1788869566.791492:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325111424:0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.791495:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325110400 00000100:00100000:1.0:1788869566.791512:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869566.791512:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325110912 00000100:00100000:0.0:1788869566.791514:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325110912 00000100:00100000:0.0:1788869566.791526:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325111424 00000100:00100000:0.0:1788869566.791529:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325111424 00000100:00100000:1.0:1788869566.791534:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325110784 00000100:00100000:1.0:1788869566.791536:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325110784 00000100:00100000:0.0:1788869566.791541:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788869566.791547:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325110400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869566.791560:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788869566.791565:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325110784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.791582:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325110400:12345-0@lo:400:kworker.0 Request processed in 34us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.791607:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788869566.791620:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788869566.791626:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325110912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869566.791640:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325110784:12345-0@lo:400:kworker.0 Request processed in 74us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869566.791646:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788869566.791649:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325110912:12345-0@lo:400:kworker.0 Request processed in 24us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.791653:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788869566.791662:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788869566.791667:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325111424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869566.791684:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325110400:0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.791690:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325111424:12345-0@lo:400:kworker.0 Request processed in 23us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869566.791693:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325110912:0@lo:400:kworker.0 00000100:00100000:1.0:1788869566.791701:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325111424:0@lo:400:kworker.0 00000100:00100000:0.0:1788869566.791704:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788869566.791742:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325110272 00000100:00080000:0.0:1788869566.791742:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869566.791746:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325110272 00000100:00080000:0.0:1788869566.791746:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869566.791749:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869566.791751:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869566.791768:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1788869566.791774:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325110272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869566.791812:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3650:x1875765325110272:12345-0@lo:400:kworker.0 Request processed in 38us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869566.791956:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869566.791989:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325111808:0@lo:400:kworker.0 00000100:00100000:3.0:1788869566.792014:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869566.792040:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325110272:0@lo:400:kworker.0 00000100:00100000:3.0:1788869566.792050:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325110784:0@lo:400:kworker.0 00000100:00100000:3.0:1788869566.792070:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325111296 00000100:00100000:3.0:1788869566.792073:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325111296 00000100:00100000:3.0:1788869566.792101:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325111808 00000100:00100000:3.0:1788869566.792105:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325111808 00000100:00100000:3.0:1788869566.792122:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788869566.792128:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325111296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869566.792162:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325111296:12345-0@lo:400:kworker.0 Request processed in 33us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869566.792168:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788869566.792180:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788869566.792186:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325111808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869566.792213:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325111808:12345-0@lo:400:kworker.0 Request processed in 29us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869566.792219:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:3.0:1788869566.792246:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869566.792249:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869566.792266:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788869566.792273:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1788869566.792288:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325111296:0@lo:400:kworker.0 00000100:00100000:3.0:1788869566.792298:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788869566.792310:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788869566.792410:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e2703910a80, transno 4294967311 00000100:00100000:3.0:1788869566.792423:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325111808:0@lo:400:kworker.0 00000100:00100000:1.0:1788869566.795455:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788869567.302012:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869567.302038:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325111936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869567.302129:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869567.302199:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325111936 00000100:00100000:2.0:1788869567.302206:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325111936 00000100:00100000:2.0:1788869567.302264:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788869567.302282:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325111936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869567.302324:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869567.302378:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325111936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.302385:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788869567.302581:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325111936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869567.303518:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869567.303534:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325112064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869567.303580:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869567.304011:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325112064 00000100:00100000:3.0:1788869567.304021:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325112064 00000100:00100000:3.0:1788869567.304066:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788869567.304074:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325112064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869567.304093:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869567.304147:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325112064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869567.304154:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788869567.304342:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325112064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788869567.685835:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869567.994578:0:14913:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:12:45 (1788869565) 00010000:00010000:1.0:1788869568.710843:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869568.839664:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869568.839700:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325112192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869568.839790:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869568.839910:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325112192 00000100:00100000:3.0:1788869568.839925:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325112192 00000100:00100000:3.0:1788869568.839985:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788869568.839997:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325112192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869568.840038:0:7831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788869568.840093:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325112192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869568.840101:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788869568.840282:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325112192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869569.734025:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869569.867400:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325112320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869569.867477:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869569.867620:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325112320 00000100:00100000:2.0:1788869569.867629:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325112320 00000100:00100000:2.0:1788869569.867695:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788869569.867706:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325112320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869569.867757:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788869569.867819:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325112320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869569.867826:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1788869569.867970:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869569.868020:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325112320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869569.869110:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869569.869126:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325112448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869569.869441:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869569.869541:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325112448 00000100:00100000:3.0:1788869569.869549:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325112448 00000100:00100000:3.0:1788869569.869640:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788869569.869649:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325112448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869569.869681:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788869569.869730:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325112448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869569.869737:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788869569.869859:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325112448:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788869569.870843:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788869569.873200:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:3.0:1788869569.873214:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788869569.873479:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788869569.873493:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788869570.759975:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869570.799758:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869570.799974:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305130496 00000100:00100000:0.0:1788869570.799985:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305130496 00000100:00100000:0.0:1788869570.800085:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 256 00000100:00100000:0.0:1788869570.800099:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+5:13180:x1875765305130496:12345-192.168.204.54@tcp:101:lsof.0 00010000:00010000:0.0:1788869570.800125:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869570.800161:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca146 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788869570.800404:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788869570.800492:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf94b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869570.800509:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869570.800521:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869570.800572:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869570.800576:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869570.800653:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869570.800683:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a9600/0x4c16c38a9b6cf944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca146 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869570.800843:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf94b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca146 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869570.800851:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:0.0:1788869570.800854:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869570.800858:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28014a8a00, rc 0) 00000100:00100000:0.0:1788869570.800967:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc71e56-b348-418d-8d54-3ebb3639d490+6:13180:x1875765305130496:12345-192.168.204.54@tcp:101:lsof.0 Request processed in 872us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869570.800975:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 256 00000100:00100000:3.0:1788869570.885901:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869570.885924:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325112576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869570.886088:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869570.886189:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325112576 00000100:00100000:1.0:1788869570.886198:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325112576 00000100:00100000:1.0:1788869570.886254:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788869570.886264:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325112576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869570.886318:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869570.886369:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325112576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869570.886376:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788869570.886609:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325112576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869571.002398:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869571.002454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869571.002497:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869571.002527:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869571.002568:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869571.002633:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869571.002664:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305130880 00000100:00100000:1.0:1788869571.002675:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305130880 00000100:00100000:1.0:1788869571.002732:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305130752 00000100:00100000:1.0:1788869571.002736:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305130752 00000100:00100000:1.0:1788869571.002753:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305131264 00000100:00100000:1.0:1788869571.002755:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305131264 00000100:00100000:1.0:1788869571.002773:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 391 00000100:00100000:1.0:1788869571.002782:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305130880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869571.002863:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305130880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 82us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869571.002871:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 391 00000100:00100000:1.0:1788869571.002905:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 392 00000100:00100000:1.0:1788869571.002911:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:2408:x1875765305130752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869571.002944:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:2408:x1875765305130752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869571.002950:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 392 00000100:00100000:1.0:1788869571.002982:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 393 00000100:00100000:1.0:1788869571.002988:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305131264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869571.003012:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2408:x1875765305131264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869571.003018:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 393 00000100:00100000:0.0:1788869571.003263:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305130624 00000100:00100000:0.0:1788869571.003268:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305130624 00000100:00100000:0.0:1788869571.003306:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 404 00000100:00100000:0.0:1788869571.003313:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305130624:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869571.003342:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305130624:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869571.003359:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 404 00000100:00100000:3.0:1788869571.003492:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305131136 00000100:00100000:3.0:1788869571.003497:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305131136 00000100:00100000:3.0:1788869571.003538:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305131008 00000100:00100000:3.0:1788869571.003541:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305131008 00000100:00100000:3.0:1788869571.003575:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:3.0:1788869571.003583:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305131136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869571.003635:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2408:x1875765305131136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 54us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869571.003642:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:3.0:1788869571.003655:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:3.0:1788869571.003661:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2408:x1875765305131008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869571.003684:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2408:x1875765305131008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869571.003689:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00080000:2.0:1788869571.003991:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869571.003996:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869571.003999:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869571.004002:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788869571.782330:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869571.910992:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325112960:0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.911005:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325112832:0@lo:400:kworker.0 00000100:00100000:0.0:1788869571.911029:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325113088:0@lo:400:kworker.0 00000100:00100000:2.0:1788869571.911108:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325112704:0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.913400:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869571.913965:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869571.914055:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325112960 00000100:00100000:0.0:1788869571.914069:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325112960 00000100:00100000:0.0:1788869571.914205:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788869571.914218:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325112960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869571.914286:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325112960:12345-0@lo:400:kworker.0 Request processed in 71us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869571.914313:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788869571.914358:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325112960:0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.914370:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325113472:0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.914402:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869571.914452:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325113984:0@lo:400:kworker.0 00000100:00100000:0.0:1788869571.914851:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325113600:0@lo:400:kworker.0 00000100:00100000:0.0:1788869571.914885:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869571.914911:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325114112:0@lo:400:kworker.0 00000100:00100000:0.0:1788869571.914932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869571.914967:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325113600 00000100:00100000:0.0:1788869571.914972:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325113600 00000100:00100000:0.0:1788869571.915009:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325114112 00000100:00100000:0.0:1788869571.915012:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325114112 00000100:00100000:0.0:1788869571.915032:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788869571.915038:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325113600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869571.915076:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325113600:12345-0@lo:400:kworker.0 Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869571.915082:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788869571.915095:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788869571.915101:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325114112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.915332:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869571.915369:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325113088 00000100:00100000:1.0:1788869571.915373:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325113088 00000100:00100000:1.0:1788869571.915401:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325113472 00000100:00100000:1.0:1788869571.915404:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325113472 00000100:00100000:1.0:1788869571.915420:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788869571.915426:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325113088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.915462:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325113088:12345-0@lo:400:kworker.0 Request processed in 36us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869571.915655:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788869571.915800:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325113984 00000100:00100000:1.0:1788869571.915805:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325113984 00000100:00100000:1.0:1788869571.915829:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788869571.915835:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325113472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.915891:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325113472:12345-0@lo:400:kworker.0 Request processed in 56us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869571.915898:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788869571.915913:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788869571.915918:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325113984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.915945:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325113984:12345-0@lo:400:kworker.0 Request processed in 27us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869571.915950:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788869571.915956:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325114112:12345-0@lo:400:kworker.0 Request processed in 855us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869571.915963:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:0.0:1788869571.915989:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788869571.915992:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e28179e5180 x1875765325113984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869571.915993:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869571.915995:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869571.916006:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325113984:0@lo:400:kworker.0 00000100:00100000:0.0:1788869571.916013:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325113088:0@lo:400:kworker.0 00010000:00080000:1.0:1788869571.916017:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e28179e6300 x1875765325113472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869571.916024:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325113600:0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.916025:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325113472:0@lo:400:kworker.0 00000100:00100000:0.0:1788869571.916034:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325114112:0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.918229:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869571.918341:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325113344:0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.918402:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869571.918448:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325113856:0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.918486:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869571.918513:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325112832 00000100:00100000:0.0:1788869571.918533:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325112832 00000100:00100000:0.0:1788869571.918633:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325113344 00000100:00100000:0.0:1788869571.918637:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325113344 00000100:00100000:0.0:1788869571.918660:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325113856 00000100:00100000:0.0:1788869571.918663:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325113856 00000100:00100000:0.0:1788869571.918680:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1788869571.918689:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325112832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.918754:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788869571.918801:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325112832:12345-0@lo:400:kworker.0 Request processed in 112us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869571.918810:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1788869571.918829:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788869571.918837:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325113856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869571.918863:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325113856:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869571.918868:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00080000:0.0:1788869571.918885:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869571.919040:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325113344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.919107:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325113344:12345-0@lo:400:kworker.0 Request processed in 343us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869571.919115:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788869571.919187:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325112832:0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.919199:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325113344:0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.919212:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325113856:0@lo:400:kworker.0 00000100:00100000:2.0:1788869571.919728:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869571.919782:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325113216:0@lo:400:kworker.0 00000100:00100000:2.0:1788869571.919829:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869571.919857:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325113728:0@lo:400:kworker.0 00000100:00100000:2.0:1788869571.919888:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869571.919896:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325113216 00000100:00100000:3.0:1788869571.919907:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325113216 00000100:00100000:2.0:1788869571.919918:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325114240:0@lo:400:kworker.0 00000100:00100000:2.0:1788869571.919963:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869571.919982:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788869571.919995:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325113216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869571.920027:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325113728 00000100:00100000:2.0:1788869571.920036:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325113728 00000100:00100000:2.0:1788869571.920099:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325114240 00000100:00100000:2.0:1788869571.920103:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325114240 00000100:00100000:2.0:1788869571.920124:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788869571.920142:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325113728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.920163:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325113216:12345-0@lo:400:kworker.0 Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869571.920176:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788869571.920201:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325113728:12345-0@lo:400:kworker.0 Request processed in 55us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869571.920210:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788869571.920231:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788869571.920241:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325114240:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788869571.920242:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869571.920272:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325114240:12345-0@lo:400:kworker.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869571.920278:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1788869571.920314:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869571.920487:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325113216:0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.920522:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325113728:0@lo:400:kworker.0 00000100:00100000:3.0:1788869571.920536:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325114240:0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.920667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325112704 00000100:00100000:1.0:1788869571.920674:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325112704 00000100:00100000:1.0:1788869571.920722:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788869571.920729:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325112704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869571.920781:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325112704:12345-0@lo:400:kworker.0 Request processed in 53us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869571.920788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1788869571.920827:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325112704:0@lo:400:kworker.0 00000100:00100000:1.0:1788869572.422458:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869572.422508:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325114368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869572.422657:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869572.423067:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325114368 00000100:00100000:2.0:1788869572.423081:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325114368 00000100:00100000:2.0:1788869572.423173:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788869572.423188:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325114368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869572.423245:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869572.423321:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325114368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869572.423329:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788869572.423393:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325114368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869572.424419:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869572.424443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325114496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869572.424518:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869572.424736:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325114496 00000100:00100000:3.0:1788869572.424745:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325114496 00000100:00100000:3.0:1788869572.424814:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788869572.424828:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325114496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869572.424857:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869572.424933:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325114496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869572.424941:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788869572.425104:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325114496:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788869572.806391:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788869572.807347:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869572.854485:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869572.854656:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305131520 00000100:00100000:3.0:1788869572.854674:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305131520 00000100:00100000:3.0:1788869572.854769:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1788869572.854784:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+19:13182:x1875765305131520:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:3.0:1788869572.855887:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:13182:x1875765305131520:12345-192.168.204.54@tcp:35:umount.0 Request processed in 1099us (1415us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788869572.855901:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1788869572.875059:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869572.875632:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305131776 00000100:00100000:1.0:1788869572.875644:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305131776 00000100:00100000:1.0:1788869572.875779:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788869572.875791:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+20:13182:x1875765305131776:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:3.0:1788869572.879528:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:13182:x1875765305131776:12345-192.168.204.54@tcp:35:umount.0 Request processed in 3724us (4469us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788869572.879546:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788869572.885939:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869572.886071:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305132032 00000100:00100000:3.0:1788869572.886083:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305132032 00000100:00100000:3.0:1788869572.886408:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1788869572.886435:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282a61f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+21:13182:x1875765305132032:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:3.0:1788869572.886739:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282a61f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:13182:x1875765305132032:12345-192.168.204.54@tcp:35:umount.0 Request processed in 306us (819us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788869572.886747:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1788869572.891077:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869572.891323:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305132288 00000100:00100000:1.0:1788869572.891336:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305132288 00000100:00100000:1.0:1788869572.891402:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1788869572.891427:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:13182:x1875765305132288:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:1.0:1788869572.892664:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:13182:x1875765305132288:12345-192.168.204.54@tcp:35:umount.0 Request processed in 1246us (1592us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788869572.892676:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1788869572.904001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869572.910657:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869572.910993:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869572.911072:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305132544 00000100:00100000:2.0:1788869572.911081:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305132544 00000100:00100000:2.0:1788869572.911153:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305132800 00000100:00100000:2.0:1788869572.911156:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305132800 00000100:00100000:2.0:1788869572.911181:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788869572.911190:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+14:2408:x1875765305132544:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869572.911227:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869572.911247:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6ce930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ca0 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869572.911263:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869572.911313:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+13:2408:x1875765305132544:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 124us (7327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869572.911320:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788869572.911339:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788869572.911363:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+12:2408:x1875765305132800:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869572.911370:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869572.911379:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6ceb4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d79 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869572.911387:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869572.911404:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+11:2408:x1875765305132800:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 44us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869572.911410:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788869572.913459:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305132672 00000100:00100000:2.0:1788869572.913479:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305132672 00000100:00100000:2.0:1788869572.913556:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788869572.913566:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+11:2408:x1875765305132672:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869572.913581:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869572.913624:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6ce873 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9c61 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869572.913640:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869572.914068:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+10:2408:x1875765305132672:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 501us (3073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869572.914078:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788869572.924370:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869572.924954:0:11338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305132416 00000100:00100000:3.0:1788869572.924965:0:11338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305132416 00000100:00100000:2.0:1788869572.925155:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:2.0:1788869572.925166:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2406:x1875765305132416:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:2.0:1788869572.925217:0:11338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cec4e 00000100:00080000:2.0:1788869572.925228:0:11338:0:(import.c:65:import_set_state_nolock()) ffff8e2704146800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869572.925315:0:11338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788869572.925534:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+2:2406:x1875765305132416:12345-192.168.204.54@tcp:9:umount.0 Request processed in 369us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869572.925541:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00010000:00010000:3.0:1788869572.929161:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869572.937049:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869572.937171:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305133184 00000100:00100000:2.0:1788869572.937181:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305133184 00000100:00100000:2.0:1788869572.937232:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1788869572.937242:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+7:2406:x1875765305133184:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:2.0:1788869572.937274:0:8443:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ceec4 00000020:00010000:2.0:1788869572.937282:0:8443:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e281127a800: total 0 00000100:00080000:2.0:1788869572.937288:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8e281127f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869572.937349:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788869572.937534:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2406:x1875765305133184:12345-192.168.204.54@tcp:9:umount.0 Request processed in 293us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869572.937542:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000020:00010000:3.0:1788869572.937625:0:6513:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e281127a800: total 0 00010000:00010000:3.0:1788869572.937669:0:6513:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e281127a800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788869572.937725:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae709dfd/0x4c16c38a9b6cf93d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca13f expref: 4 pid: 11338 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869572.937758:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004788d3d/0x4c16c38a9b6cf27c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f63 expref: 3 pid: 11338 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869572.937772:0:6513:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e281127a800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788869572.937785:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869572.937787:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869572.937789:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869572.944978:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869572.945125:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305134208 00000100:00100000:0.0:1788869572.945137:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305134208 00000100:00100000:0.0:1788869572.945213:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 257 00000100:00100000:0.0:1788869572.945225:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+23:2406:x1875765305134208:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:0.0:1788869572.945281:0:6524:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce881 00000020:00010000:0.0:1788869572.945299:0:6524:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e2703415800: total 0 00000100:00080000:0.0:1788869572.945305:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8e2703410000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788869572.945340:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:1.0:1788869572.945429:0:7475:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e2703415800: total 0 00010000:00010000:1.0:1788869572.945489:0:7475:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2703415800, canceled 0 locks, left on hash table 14. 00000100:00100000:0.0:1788869572.945513:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+22:2406:x1875765305134208:12345-192.168.204.54@tcp:39:umount.0 Request processed in 291us (545us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788869572.945520:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 257 00010000:00010000:1.0:1788869572.945526:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:1.0:1788869572.945529:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788869572.945537:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda000/0x4c16c38a9b6cf2f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f7f expref: 21 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945558:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:1.0:1788869572.945560:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788869572.945564:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb800/0x4c16c38a9b6cf8f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca12a expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945639:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ecce00) 00010000:00010000:1.0:1788869572.945642:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869572.945647:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fa00/0x4c16c38a9b6cebc9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d8e expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945682:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:1.0:1788869572.945684:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869572.945688:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8a00/0x4c16c38a9b6cf23d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f4e expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945699:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:1.0:1788869572.945702:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788869572.945705:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cf267 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f5c expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945716:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:1.0:1788869572.945719:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869572.945722:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5200/0x4c16c38a9b6cf5e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca058 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945737:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869572.945739:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869572.945743:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6cef1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9e7c expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945754:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:1.0:1788869572.945756:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869572.945767:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6cf2d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f78 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945793:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:1.0:1788869572.945796:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788869572.945800:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8200/0x4c16c38a9b6cf928 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca138 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945812:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:1.0:1788869572.945814:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869572.945818:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda800/0x4c16c38a9b6cf81e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca0f2 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945829:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e280839c300) 00010000:00010000:1.0:1788869572.945831:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869572.945837:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6cf15d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9f16 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945851:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2803b9b000) 00010000:00010000:1.0:1788869572.945853:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869572.945857:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cebad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d87 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945869:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e2809bdc800) 00010000:00010000:1.0:1788869572.945872:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869572.945876:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8600/0x4c16c38a9b6cf91a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca131 expref: 9 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945891:0:7475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e28029d9800) 00010000:00010000:1.0:1788869572.945909:0:7475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788869572.945916:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8000/0x4c16c38a9b6cec24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9da3 expref: 8 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869572.945932:0:7475:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2703415800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1788869572.945950:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869572.945952:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869572.945954:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869572.955909:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869572.956019:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305134336 00000100:00100000:3.0:1788869572.956030:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305134336 00000100:00100000:3.0:1788869572.956139:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 258 00000100:00100000:3.0:1788869572.956150:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+5:2406:x1875765305134336:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:3.0:1788869572.956184:0:6526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce888 00000100:00080000:3.0:1788869572.956218:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8e2703a1d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869572.956282:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788869572.956491:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91cba2f3-33fb-476e-a4a1-b4fbee1b176d+3:2406:x1875765305134336:12345-192.168.204.54@tcp:39:umount.0 Request processed in 342us (599us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788869572.956500:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 258 00010000:00010000:0.0:1788869572.957992:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869573.253847:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869573.253859:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869573.253981:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788869573.253990:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788869573.832170:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869573.958134:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869573.958168:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325114624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869573.958280:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869573.958572:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325114624 00000100:00100000:1.0:1788869573.958582:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325114624 00000100:00100000:1.0:1788869573.958669:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788869573.958680:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325114624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869573.958719:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788869573.958785:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325114624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869573.958792:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788869573.959125:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325114624:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869574.856290:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869574.982372:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325114752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869574.982467:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869574.982617:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325114752 00000100:00100000:3.0:1788869574.982627:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325114752 00000100:00100000:3.0:1788869574.982699:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788869574.982711:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325114752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869574.982748:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1788869574.982848:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869574.984133:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325114752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1419us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869574.984145:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788869574.989560:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869574.989632:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325114880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869574.989715:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869574.989848:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325114880 00000100:00100000:2.0:1788869574.989858:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325114880 00000100:00100000:2.0:1788869574.989945:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788869574.989956:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325114880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869574.989984:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788869574.990034:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325114880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869574.990041:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788869574.990118:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325114880:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869574.990579:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869574.997149:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325114752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869575.580974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869575.581017:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869575.581179:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869575.581398:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305134464 00000100:00100000:2.0:1788869575.581410:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305134464 00000100:00100000:2.0:1788869575.581514:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305134720 00000100:00100000:2.0:1788869575.581518:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305134720 00000100:00100000:3.0:1788869575.581632:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305134592 00000100:00100000:3.0:1788869575.581636:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305134592 00000100:00100000:0.0:1788869575.581660:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1788869575.581671:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788869575.581677:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+12:2410:x1875765305134464:12345-192.168.204.54@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788869575.581686:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:448e652b-ca43-4915-9c32-5166fb543df5+12:2410:x1875765305134720:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869575.581695:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869575.581696:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869575.581722:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe1600/0x4c16c38a9b6ceb44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9d72 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869575.581722:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6ce984 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9cb5 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869575.581754:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869575.581754:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869575.581812:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+10:2410:x1875765305134464:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 141us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869575.581821:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1788869575.581852:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788869575.581860:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+9:2410:x1875765305134592:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869575.581869:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869575.581880:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe0c00/0x4c16c38a9b6ce98b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ce6 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869575.581889:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869575.582351:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:448e652b-ca43-4915-9c32-5166fb543df5+8:2410:x1875765305134720:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 668us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869575.582360:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788869575.585406:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:448e652b-ca43-4915-9c32-5166fb543df5+7:2410:x1875765305134592:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3532us (4212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869575.585425:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1788869575.588655:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869575.589968:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305134976 00000100:00100000:1.0:1788869575.589984:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305134976 00000100:00100000:1.0:1788869575.590146:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 259 00000100:00100000:1.0:1788869575.590158:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+6:2406:x1875765305134976:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:1.0:1788869575.590340:0:6524:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce999 00000020:00010000:1.0:1788869575.590353:0:6524:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e2703ac1000: total 0 00000100:00080000:1.0:1788869575.590361:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8e2703ac3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869575.590572:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788869575.590650:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788869575.590799:0:6512:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e2703ac1000: total 0 00010000:00010000:0.0:1788869575.590804:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869575.590807:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc71e56-b348-418d-8d54-3ebb3639d490+5:2406:x1875765305134976:12345-192.168.204.54@tcp:39:umount.0 Request processed in 652us (2161us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1788869575.590834:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 259 00010000:00010000:0.0:1788869575.590858:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2703ac1000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788869575.590897:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e280839c100) 00010000:00010000:0.0:1788869575.590901:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869575.590910:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28014a8a00/0x4c16c38a9b6cf94b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca146 expref: 4 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869575.590940:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2703ac1000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788869575.590952:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869575.590954:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869575.590956:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869575.608657:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869575.608987:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305135104 00000100:00100000:1.0:1788869575.608999:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305135104 00000100:00100000:1.0:1788869575.609302:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 260 00000100:00100000:1.0:1788869575.609314:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+5:2406:x1875765305135104:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:1.0:1788869575.609367:0:8260:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce9a0 00000100:00080000:1.0:1788869575.609381:0:8260:0:(import.c:65:import_set_state_nolock()) ffff8e2703411000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869575.609425:0:8260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1788869575.609478:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869575.610308:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869575.610452:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc71e56-b348-418d-8d54-3ebb3639d490+3:2406:x1875765305135104:12345-192.168.204.54@tcp:39:umount.0 Request processed in 1136us (1860us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788869575.610463:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 260 00000100:00100000:2.0:1788869575.668524:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869575.668624:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305135360 00000100:00100000:1.0:1788869575.668641:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305135360 00000100:00100000:1.0:1788869575.668718:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 406 00000100:00100000:1.0:1788869575.668731:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+7:2406:x1875765305135360:12345-192.168.204.54@tcp:251:umount.0 00000020:00000080:1.0:1788869575.668785:0:6519:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce85e 00000020:00010000:1.0:1788869575.668793:0:6519:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e282dbab800: total 0 00000100:00080000:1.0:1788869575.668799:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8e282dbab000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788869575.668882:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:448e652b-ca43-4915-9c32-5166fb543df5+3:2406:x1875765305135360:12345-192.168.204.54@tcp:251:umount.0 Request processed in 153us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869575.668890:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 406 00000020:00010000:2.0:1788869575.669255:0:7475:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e282dbab800: total 0 00010000:00010000:2.0:1788869575.669317:0:7475:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e282dbab800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788869575.669357:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7e200/0x4c16c38a9b6ce937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fc9ca7 expref: 2 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869575.669373:0:7475:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e282dbab800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788869575.669386:0:7475:0:(genops.c:885:class_export_put()) final put ffff8e282dbab800/448e652b-ca43-4915-9c32-5166fb543df5 00010000:00010000:2.0:1788869575.669405:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869575.669407:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869575.669409:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788869575.670614:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282dbab800/448e652b-ca43-4915-9c32-5166fb543df5 for MGS 00000020:00000080:0.0:1788869575.670661:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282dbab000 for MGS 00010000:00010000:0.0:1788869575.877915:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869576.005889:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869576.005923:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325115008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869576.006009:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869576.006126:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325115008 00000100:00100000:3.0:1788869576.006139:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325115008 00000100:00100000:3.0:1788869576.006208:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788869576.006219:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325115008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869576.006259:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869576.006899:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325115008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 680us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869576.006909:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788869576.006972:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325115008:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788869576.901686:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869577.032188:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325115264:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032281:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032345:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325115776:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032368:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032392:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325116288:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032413:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032436:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788869577.032443:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325115136:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032470:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032493:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325115648:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032518:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032536:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325116160:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032561:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032577:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325116672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032633:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032664:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325115392:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032688:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032706:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325115904:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032728:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032745:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325116416:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032765:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032777:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788869577.032782:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325115520:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032816:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032828:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325116032:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032857:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032876:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325116544:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.032896:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869577.032928:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325115264 00000100:00100000:0.0:1788869577.032936:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325115264 00000100:00100000:0.0:1788869577.032974:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325115776 00000100:00100000:0.0:1788869577.032977:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325115776 00000100:00100000:0.0:1788869577.033001:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325116288 00000100:00100000:0.0:1788869577.033004:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325116288 00000100:00100000:0.0:1788869577.033017:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325115904 00000100:00100000:0.0:1788869577.033020:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325115904 00000100:00100000:0.0:1788869577.033045:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325116416 00000100:00100000:0.0:1788869577.033048:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325116416 00000100:00100000:0.0:1788869577.033060:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325115520 00000100:00100000:0.0:1788869577.033063:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325115520 00000100:00100000:0.0:1788869577.033076:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788869577.033086:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325115264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033143:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325115264:12345-0@lo:400:kworker.0 Request processed in 57us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033151:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788869577.033167:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788869577.033173:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325115776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033200:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325115776:12345-0@lo:400:kworker.0 Request processed in 27us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033206:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788869577.033218:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788869577.033224:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325116288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033252:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325116288:12345-0@lo:400:kworker.0 Request processed in 28us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033266:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788869577.033278:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788869577.033284:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325115904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033315:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325115904:12345-0@lo:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033321:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788869577.033332:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788869577.033339:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325116416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033365:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325116416:12345-0@lo:400:kworker.0 Request processed in 27us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033371:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788869577.033382:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788869577.033388:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325115520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033414:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325115520:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033419:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788869577.033447:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325115136 00000100:00100000:0.0:1788869577.033451:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325115136 00000100:00100000:0.0:1788869577.033478:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788869577.033484:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325115136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033515:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3649:x1875765325115136:12345-0@lo:400:kworker.0 Request processed in 31us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033521:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788869577.033549:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325115648 00000100:00100000:0.0:1788869577.033553:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325115648 00000100:00100000:0.0:1788869577.033606:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325115392 00000100:00100000:0.0:1788869577.033610:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325115392 00000100:00100000:0.0:1788869577.033626:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788869577.033632:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325115648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033666:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325115648:12345-0@lo:400:kworker.0 Request processed in 34us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033672:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788869577.033684:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788869577.033690:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325115392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033716:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325115392:12345-0@lo:400:kworker.0 Request processed in 27us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033722:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788869577.033741:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325116160 00000100:00100000:0.0:1788869577.033744:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325116160 00000100:00100000:0.0:1788869577.033768:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325116672 00000100:00100000:0.0:1788869577.033771:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325116672 00000100:00100000:0.0:1788869577.033783:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325116032 00000100:00100000:0.0:1788869577.033785:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325116032 00000100:00100000:0.0:1788869577.033797:0:8743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325116544 00000100:00100000:0.0:1788869577.033799:0:8743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325116544 00000100:00100000:0.0:1788869577.033811:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788869577.033816:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325116160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.033848:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325116160:12345-0@lo:400:kworker.0 Request processed in 32us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.033854:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788869577.034073:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788869577.034081:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325116672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034112:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325116672:12345-0@lo:400:kworker.0 Request processed in 32us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.034126:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788869577.034138:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788869577.034144:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325116032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034174:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325116032:12345-0@lo:400:kworker.0 Request processed in 30us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.034179:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788869577.034189:0:8743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788869577.034194:0:8743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325116544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034220:0:8743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325116544:12345-0@lo:400:kworker.0 Request processed in 25us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869577.034226:0:8743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1788869577.034264:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869577.034269:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869577.034271:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869577.034273:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869577.034321:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325115520:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034332:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325116032:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034340:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325116544:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034350:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325115392:0@lo:400:kworker.0 00010000:00080000:0.0:1788869577.034363:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2841001500 x1875765325115904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869577.034374:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325115904:0@lo:400:kworker.0 00010000:00080000:0.0:1788869577.034386:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a1f80 x1875765325116416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869577.034403:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325116416:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034446:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325115136:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034459:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325115648:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034469:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325116160:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034478:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325116672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034488:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325115264:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034498:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325115776:0@lo:400:kworker.0 00000100:00100000:0.0:1788869577.034508:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325116288:0@lo:400:kworker.0 00000100:00100000:2.0:1788869577.544378:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869577.544414:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325116800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869577.544493:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869577.544602:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325116800 00000100:00100000:2.0:1788869577.544610:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325116800 00000100:00100000:2.0:1788869577.544659:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788869577.544668:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325116800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869577.544703:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869577.544756:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325116800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869577.544763:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788869577.544838:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325116800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869577.557872:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325116928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869577.557959:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869577.558060:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325116928 00000100:00100000:2.0:1788869577.558069:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325116928 00000100:00100000:2.0:1788869577.558126:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869577.558137:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325116928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869577.558159:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869577.558207:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325116928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869577.558214:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869577.558271:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325116928:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1788869577.753959:0:15109:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788869577.780312:0:15109:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788869577.780399:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869577.780422:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869577.780431:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869577.780439:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869577.782130:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869577.782150:0:15109:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788869577.782786:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869577.782799:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788869577.782824:0:15109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788869577.782856:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8e2817985000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788869577.785774:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325117056:0@lo:39:umount.0 00000100:00100000:3.0:1788869577.785910:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869577.786798:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325117056 00000100:00100000:1.0:1788869577.786814:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325117056 00000100:00100000:1.0:1788869577.786916:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788869577.786929:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765325117056:12345-0@lo:39:umount.0 00010000:00010000:3.0:1788869577.787731:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869577.787748:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.787765:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5e00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869577.787771:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.787784:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869577.787794:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869577.787831:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869577.787835:0:7475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788869577.787840:0:7475:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788869577.787902:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.787911:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788869577.788006:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325117184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869577.788101:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.788111:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5e00/0x4c16c38a9b6ce906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce90d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.788130:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869577.788132:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869577.788134:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869577.788257:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869577.789164:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325117184 00000100:00100000:3.0:1788869577.789179:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325117184 00000100:00100000:3.0:1788869577.789263:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869577.789275:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+24:3651:x1875765325117184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869577.789301:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869577.789323:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7fc00/0x4c16c38a9b6ce90d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce906 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.789343:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869577.789431:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:3651:x1875765325117184:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869577.789439:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869577.790140:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3651:1875765325117184:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788869577.792217:0:6525:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce475 00000100:00080000:1.0:1788869577.792237:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8e282da7d800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788869577.792464:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869577.792815:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1875765325117056:12345-0@lo:39:umount.0 Request processed in 5881us (6900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869577.792828:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:1.0:1788869577.792863:0:6525:0:(genops.c:885:class_export_put()) final put ffff8e282da79000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788869577.794908:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282da79000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788869577.795032:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282da7d800 for lustre-MDT0000 00000100:00080000:3.0:1788869577.795118:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2817985000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788869577.795144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325117056:0@lo:39:umount.0 00000100:00080000:1.0:1788869577.795188:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869577.795202:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788869577.795212:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788869577.803705:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803733:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803742:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803751:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803821:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869577.803830:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803837:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803843:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803849:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803868:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869577.803885:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869577.803894:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803902:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe0e00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869577.803906:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.803919:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869577.803928:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869577.803935:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869577.803939:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1788869577.803951:0:7475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788869577.803959:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869577.803986:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869577.803992:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869577.804005:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869577.804026:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869577.804061:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869577.804064:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788869577.804069:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788869577.804131:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869577.804138:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869577.804180:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869577.804189:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840eda200/0x4c16c38a9b6ce818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce81f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869577.804209:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869577.804211:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869577.804212:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869577.804222:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869577.804248:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325117440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869577.804409:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869577.804478:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325117440 00000100:00100000:1.0:1788869577.804486:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325117440 00000100:00100000:1.0:1788869577.804546:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869577.804556:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+23:3649:x1875765325117440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869577.804570:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869577.804618:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2800031800/0x4c16c38a9b6ce81f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce818 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869577.804804:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869577.804862:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3649:x1875765325117440:12345-0@lo:103:ldlm_bl.0 Request processed in 307us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869577.804870:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869577.804936:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325117440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869577.805374:0:7475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.805388:0:7475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869577.805418:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.805426:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbe0e00/0x4c16c38a9b6ce914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce91b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.805444:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869577.805446:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869577.805448:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869577.805839:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325117312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869577.805901:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869577.805956:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325117312 00000100:00100000:1.0:1788869577.805964:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325117312 00000100:00100000:1.0:1788869577.807151:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869577.807170:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3649:x1875765325117312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869577.807188:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869577.807209:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe1800/0x4c16c38a9b6ce91b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce914 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869577.807225:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869577.807290:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3649:x1875765325117312:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869577.807297:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869577.807797:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325117312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869577.808447:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.808466:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.808473:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.808480:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.808561:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869577.808571:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.808579:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.808641:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869577.808647:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815507:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869577.815539:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815557:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe1400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869577.815565:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815577:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869577.815624:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869577.815632:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788869577.815635:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788869577.815640:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788869577.815718:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815726:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869577.815765:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815773:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1400/0x4c16c38a9b6ceb7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ceb83 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815821:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869577.815826:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815833:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8e00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869577.815836:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815844:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869577.815850:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869577.815856:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869577.815859:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1788869577.815874:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815881:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869577.815888:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869577.815896:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869577.815898:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869577.815902:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869577.815953:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325117568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869577.816091:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869577.816138:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325117568 00000100:00100000:1.0:1788869577.816160:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325117568 00000100:00100000:3.0:1788869577.816174:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869577.816193:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325117696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869577.816228:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869577.816266:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325117696 00000100:00100000:1.0:1788869577.816272:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325117696 00000100:00100000:1.0:1788869577.816320:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869577.816345:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+22:3650:x1875765325117568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869577.816365:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869577.816387:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb4c00/0x4c16c38a9b6ceb83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb7c expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869577.816433:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869577.816526:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+21:3650:x1875765325117568:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869577.816533:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869577.816570:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869577.816577:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+20:3650:x1875765325117696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869577.816616:0:10401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869577.816627:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6ce3db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce3d4 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869577.816637:0:10401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869577.816676:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39+19:3650:x1875765325117696:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869577.816683:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788869577.817352:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788869577.817377:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6ce3d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce3db expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869577.817400:0:15109:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1788869577.817409:0:15109:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788869577.817411:0:15109:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788869577.817474:0:15109:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788869577.817479:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788869577.817486:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869577.817504:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788869577.817512:0:15109:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2701f1d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869577.817520:0:15109:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e283dfee800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869577.817525:0:15109:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2840c4a800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869577.817529:0:15109:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2817980000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1788869577.817538:0:15109:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8e2703ac1000 acc71e56-b348-418d-8d54-3ebb3639d490 192.168.204.54@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869577.817543:0:15109:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8e2703415800 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 192.168.204.54@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:0.0:1788869577.817549:0:15109:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8e28179fcd40) has exports, disconnecting them 00000020:00080000:0.0:1788869577.817555:0:15109:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2701f1d000), last request at 1788869577 00000020:00000080:0.0:1788869577.817566:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce785 00000100:00080000:0.0:1788869577.817624:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8e2701f18000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788869577.817703:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788869577.817723:0:15109:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2701f1d000): rc 0 00000020:00000080:0.0:1788869577.817728:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2701f1d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788869577.817746:0:15109:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e283dfee800), last request at 1788869577 00000020:00000080:0.0:1788869577.817751:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce65f 00000100:00080000:0.0:1788869577.817760:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8e283dfe9000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788869577.817773:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325117696:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788869577.817778:0:15109:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e283dfee800): rc 0 00000020:00000080:0.0:1788869577.817784:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e283dfee800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1788869577.817786:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788869577.817793:0:15109:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2840c4a800), last request at 1788869323 00000100:00100000:3.0:1788869577.817796:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325117568:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788869577.817800:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce55c 00000100:00080000:0.0:1788869577.817809:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8e2840c48000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788869577.817832:0:15109:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2840c4a800): rc 0 00010000:00010000:3.0:1788869577.817834:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788869577.817835:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2840c4a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788869577.817843:0:15109:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2817980000), last request at 1788869323 00000020:00000080:0.0:1788869577.817848:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce51d 00000100:00080000:0.0:1788869577.817853:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8e2840b9a000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788869577.817859:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788869577.817881:0:15109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00010000:00010000:3.0:1788869577.817897:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788869577.818143:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2701f1d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:0.0:1788869577.818866:0:15109:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2817980000): rc 0 00000004:00000080:0.0:1788869577.818877:0:15109:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb9f680d53ae0 00000100:00080000:0.0:1788869577.819043:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788869577.819049:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000020:00000080:2.0:1788869577.821677:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283dfee800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788869577.821789:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788869577.821822:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2701f18000 for lustre-MDT0000 00000020:00000080:2.0:1788869577.821830:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e283dfe9000 for lustre-MDT0000 00000020:00000080:2.0:1788869577.821835:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2840c48000 for lustre-MDT0000 00000100:00080000:0.0:1788869577.825313:0:15109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788869577.825360:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8e2840d20000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788869577.825454:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325117824:0@lo:39:umount.0 00000100:00100000:3.0:1788869577.825534:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869577.825789:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325117824 00000100:00100000:1.0:1788869577.825800:0:7831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325117824 00000100:00100000:1.0:1788869577.825879:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788869577.825890:0:7831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765325117824:12345-0@lo:39:umount.0 00000100:00080000:0.0:1788869577.825915:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788869577.825921:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000020:00000080:1.0:1788869577.825925:0:7831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce5b7 00000100:00080000:1.0:1788869577.825935:0:7831:0:(import.c:65:import_set_state_nolock()) ffff8e2840c4b800 : changing import state from FULL to CLOSED 00000004:00080000:0.0:1788869577.825938:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000001:00000004:1.0:1788869577.825966:0:7831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:0.0:1788869577.826032:0:15109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788869577.826046:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8e282dac2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788869577.826077:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788869577.826080:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1788869577.826088:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788869577.826149:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325117952:0@lo:9:umount.0 00000100:00100000:1.0:1788869577.826153:0:7831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3647:x1875765325117824:12345-0@lo:39:umount.0 Request processed in 262us (614us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788869577.826173:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00010000:1.0:1788869577.826234:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869577.826243:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869577.826315:0:15109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788869577.826331:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8e2702582000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788869577.826337:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2840d20000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788869577.826348:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325117824:0@lo:39:umount.0 00000100:00100000:2.0:1788869577.826369:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325118080:0@lo:9:umount.0 00000100:00100000:2.0:1788869577.826401:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788869577.826434:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e28179fcd40) has no exports 00000100:00100000:2.0:1788869577.826460:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325117952 00000100:00100000:2.0:1788869577.826470:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325117952 00000100:00100000:2.0:1788869577.826524:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325118080 00000100:00100000:2.0:1788869577.826528:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325118080 00000100:00100000:2.0:1788869577.826557:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869577.826568:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765325117952:12345-0@lo:9:umount.0 00000100:00100000:0.0:1788869577.826628:0:11338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869577.826643:0:11338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765325118080:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788869577.826648:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce707 00000100:00080000:2.0:1788869577.826659:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788869577.826666:0:11338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce849 00000100:00080000:0.0:1788869577.826676:0:11338:0:(import.c:65:import_set_state_nolock()) ffff8e2702584800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869577.826730:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000001:00000004:0.0:1788869577.826733:0:11338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788869577.826957:0:11338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3647:x1875765325118080:12345-0@lo:9:umount.0 Request processed in 305us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869577.826964:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3647:x1875765325117952:12345-0@lo:9:umount.0 Request processed in 393us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869577.826974:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1788869577.827126:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869577.827174:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2702582000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788869577.827195:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788869577.827197:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788869577.827201:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325118080:0@lo:9:umount.0 00000100:00080000:2.0:1788869577.827213:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282dac2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788869577.827224:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788869577.827225:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788869577.827228:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325117952:0@lo:9:umount.0 00000100:00100000:0.0:1788869577.827319:0:11338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:0.0:1788869577.827353:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788869577.848051:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e28179fcd40) has no exports 00000020:00000080:0.0:1788869577.942910:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce42f 00000020:00000080:0.0:1788869577.942934:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2829c0f800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788869577.943053:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00010000:00010000:1.0:1788869577.943252:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788869577.945604:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2829c0f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788869577.945740:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869577.945754:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869577.945760:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8e2802bd0000) has no exports 00000020:00000080:2.0:1788869577.946136:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce428 00000020:00000080:2.0:1788869577.946145:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e282d8ce800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788869577.946206:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869577.946215:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788869577.946218:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2808346800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788869577.946220:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2808346800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788869577.946229:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788869577.946424:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282d8ce800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788869578.952255:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869579.079839:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325118208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869579.079925:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869579.080680:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325118208 00000100:00100000:0.0:1788869579.080695:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325118208 00000100:00100000:0.0:1788869579.080755:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788869579.080767:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875765325118208:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788869579.080778:0:6530:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788869579.080842:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875765325118208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (916us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788869579.080849:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:02020000:2.0:1788869579.082062:0:3648:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:1.0:1788869579.088510:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788869579.088521:0:6503:0:(genops.c:885:class_export_put()) final put ffff8e2817980000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788869579.088536:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of acc71e56-b348-418d-8d54-3ebb3639d490 00000001:00080000:1.0:1788869579.088547:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1788869579.088552:0:6503:0:(genops.c:885:class_export_put()) final put ffff8e2703ac1000/acc71e56-b348-418d-8d54-3ebb3639d490 00000001:00100000:1.0:1788869579.088572:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000001:00080000:1.0:1788869579.088578:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788869579.088623:0:6503:0:(genops.c:885:class_export_put()) final put ffff8e2703415800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000001:00100000:1.0:1788869579.088676:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869579.088680:0:8435:0:(genops.c:885:class_export_put()) final put ffff8e27029d2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788869579.088688:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:1.0:1788869579.088690:0:8435:0:(genops.c:885:class_export_put()) final put ffff8e281127a800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:1.0:1788869579.088737:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817980000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788869579.088826:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703ac1000/acc71e56-b348-418d-8d54-3ebb3639d490 for lustre-MDT0000 00000020:00000080:1.0:1788869579.088859:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703415800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d for lustre-MDT0000 00000020:00000080:1.0:1788869579.088894:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788869579.088917:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e281127a800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d for lustre-OST0000 00000020:00000080:1.0:1788869579.088935:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2840b9a000 for lustre-MDT0000 00000020:00000080:1.0:1788869579.088940:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2703ac3000 for lustre-MDT0000 00000020:00000080:1.0:1788869579.088944:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2703410000 for lustre-MDT0000 00000020:00000080:1.0:1788869579.088947:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e27029d0000 for lustre-OST0000 00000020:00000080:1.0:1788869579.088950:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e281127f000 for lustre-OST0000 00000001:00100000:0.0:1788869579.090640:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869579.090648:0:9520:0:(genops.c:885:class_export_put()) final put ffff8e2702581800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788869579.090684:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:0.0:1788869579.090687:0:9520:0:(genops.c:885:class_export_put()) final put ffff8e2704145800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:3.0:1788869579.091117:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2702581800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788869579.091166:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2704145800/91cba2f3-33fb-476e-a4a1-b4fbee1b176d for lustre-OST0001 00000020:00000080:3.0:1788869579.091201:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2702584800 for lustre-OST0001 00000020:00000080:3.0:1788869579.091206:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2704146800 for lustre-OST0001 00000001:00100000:1.0:1788869579.091843:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788869579.091857:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1788869579.091861:0:7456:0:(genops.c:885:class_export_put()) final put ffff8e282db06000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788869579.091875:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of acc71e56-b348-418d-8d54-3ebb3639d490 00000001:00080000:1.0:1788869579.091953:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1788869579.091955:0:7456:0:(genops.c:885:class_export_put()) final put ffff8e2703414800/acc71e56-b348-418d-8d54-3ebb3639d490 00000001:00100000:1.0:1788869579.091963:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000001:00080000:1.0:1788869579.091969:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1788869579.092042:0:7456:0:(genops.c:885:class_export_put()) final put ffff8e2703a1f000/91cba2f3-33fb-476e-a4a1-b4fbee1b176d 00000020:00000080:0.0:1788869579.092056:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db06000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788869579.092105:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703414800/acc71e56-b348-418d-8d54-3ebb3639d490 for lustre-MDT0001 00000020:00000080:0.0:1788869579.092136:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703a1f000/91cba2f3-33fb-476e-a4a1-b4fbee1b176d for lustre-MDT0001 00000020:00000080:0.0:1788869579.092172:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2840c4b800 for lustre-MDT0001 00000020:00000080:0.0:1788869579.092176:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2703411000 for lustre-MDT0001 00000020:00000080:0.0:1788869579.092179:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2703a1d800 for lustre-MDT0001 00000100:00080000:2.0:1788869579.104065:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788869579.104083:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e282dac4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788869579.104094:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788869579.142507:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e282dac4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869579.142534:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 257 00000100:00080000:2.0:1788869579.142560:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e282dac4000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869579.142818:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a2d80 x1875765325118336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869579.143290:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325118336:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788869579.143409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869579.143475:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325118336 00000100:00100000:1.0:1788869579.143489:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325118336 00000100:00100000:1.0:1788869579.143559:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788869579.143569:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325118336:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788869579.143613:0:6529:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788869579.162816:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325118336:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 19231us (19390us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788869579.162836:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:2.0:1788869579.162951:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282dac4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869579.162964:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869579.162971:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325118336:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1788869579.973976:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788869579.974331:0:15109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2703549000 - data ffff8e2831f04bd0/ffff8e282f0c2800 00000020:01000000:2.0:1788869579.974544:0:15109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e282da23b40 - data ffff8e2831d75870/ffff8e282da75000 00000001:00000004:2.0:1788869579.990952:0:15109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1788869580.077680:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869580.077691:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788869580.077708:0:15109:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e27028a2a00 x1875765325117824/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788869587 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869580.077736:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788869580.080474:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788869580.080483:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788869580.080510:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788869580.080513:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788869580.081518:0:8737:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788869580.081528:0:8737:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788869580.081542:0:8737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788869580.082363:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788869580.082369:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788869580.082388:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788869580.082390:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788869580.083193:0:9792:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788869580.083198:0:9792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788869580.083209:0:9792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788869580.084320:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce3f7 00000020:00000080:2.0:1788869580.084332:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2817980800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788869580.086505:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce40c 00000020:00000080:2.0:1788869580.086521:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2829c0f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869580.091449:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817980800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788869580.092202:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788869580.092383:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869580.092393:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788869580.092398:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8e282a934d40) has no exports 00000004:01000000:3.0:1788869580.092613:0:15109:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788869580.092622:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce842 00000020:00000080:3.0:1788869580.092631:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2703413800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788869580.092636:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788869580.092640:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869580.092660:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788869580.092662:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8e2840a399c0) has no exports 00000020:00000080:3.0:1788869580.092669:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce83b 00000020:00000080:3.0:1788869580.092673:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e27029d7000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788869580.093131:0:15109:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788869580.093136:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788869580.093140:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788869580.093147:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869580.093149:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869580.093892:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2829c0f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788869580.093907:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703413800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788869580.093912:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788869580.094016:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869580.094029:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788869580.094036:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce700 00000020:00000080:3.0:1788869580.094042:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2701f1f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788869580.094047:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788869580.094053:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869580.094058:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788869580.094062:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8e27025e8000) has no exports 00000020:00000080:3.0:1788869580.094067:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce6f9 00000020:00000080:3.0:1788869580.094070:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e282dac0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788869580.094951:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2702582000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788869580.094975:0:475:0:(genops.c:885:class_export_put()) final put ffff8e27036c6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869580.094979:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27036c6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788869580.094986:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869580.095076:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2701f1f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788869580.095082:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282dac0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788869580.096976:0:15109:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788869580.096984:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788869580.096988:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788869580.096996:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869580.096998:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869580.097047:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869580.097062:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788869580.097078:0:15109:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788869580.097084:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce5b0 00000020:00000080:3.0:1788869580.097092:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2840c4c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788869580.097098:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788869580.097105:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869580.097110:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788869580.097124:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e2802bd4d40) has no exports 00000020:00000080:3.0:1788869580.097131:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce5a9 00000020:00000080:3.0:1788869580.097135:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2840d25800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788869580.098029:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282dac2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788869580.098039:0:475:0:(genops.c:885:class_export_put()) final put ffff8e2702746800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869580.098042:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2702746800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788869580.098049:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869580.098129:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788869580.098135:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840d25800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788869580.098825:0:15109:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788869580.098830:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869580.098839:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788869580.098844:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869580.098892:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869580.098902:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869580.098932:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869580.098936:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869580.098940:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2817986800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788869580.098943:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817986800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788869580.098943:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2840d20000 for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788869580.098949:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869580.098951:0:475:0:(genops.c:885:class_export_put()) final put ffff8e2840d27800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869580.098953:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840d27800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788869580.098956:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869580.099034:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce413 00000020:00000080:2.0:1788869580.099040:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2829c0e000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788869580.099053:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788869580.099056:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869580.099061:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788869580.099065:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8e28179f99c0) has no exports 00000020:00000080:2.0:1788869580.099099:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869580.099103:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788869580.099108:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce41a 00000020:00000080:2.0:1788869580.099112:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2829c08800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788869580.099124:0:15109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e281757b800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788869580.099127:0:15109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e281757b800 3 00000020:01000004:2.0:1788869580.099130:0:15109:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e281757b800 from lustre-MDT0000 00000020:00000080:1.0:1788869580.099139:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2829c0e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788869580.099143:0:475:0:(genops.c:885:class_export_put()) final put ffff8e2817987000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788869580.099145:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817987000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788869580.099148:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788869580.099152:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869580.099156:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788869580.099158:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2817985800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788869580.099160:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817985800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788869580.099177:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1788869580.099180:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2829c08800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1788869580.099206:0:15109:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788869580.099211:0:15109:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788869580.099214:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788869580.099216:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869580.099219:0:15109:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788869580.099231:0:15109:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8e282aaf2800 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869580.099237:0:15109:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8e2802bd3380) has exports, disconnecting them 00000020:00080000:2.0:1788869580.099241:0:15109:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e282aaf2800), last request at 1788869304 00000020:00000080:2.0:1788869580.099257:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce3b8 00000020:00010000:2.0:1788869580.099261:0:15109:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e282aaf2800: total 0 00000100:00080000:2.0:1788869580.099265:0:15109:0:(import.c:65:import_set_state_nolock()) ffff8e282aaf0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788869580.099283:0:15109:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e282aaf2800): rc 0 00000020:00080000:2.0:1788869580.099288:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8e2802bd3380) has no exports 00000020:00010000:1.0:1788869580.101099:0:6512:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e282aaf2800: total 0 00010000:00010000:1.0:1788869580.101170:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e282aaf2800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788869580.101209:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe0200/0x4c16c38a9b6ce8f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8ea expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101231:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6ce8ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8f8 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101242:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d7000/0x4c16c38a9b6ce4b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce4ad expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101259:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28014a9c00/0x4c16c38a9b6ce4c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce4bb expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101272:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe0a00/0x4c16c38a9b6ceb59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb52 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101282:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6ceb67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb60 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101294:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6ce8c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8c0 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101326:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe1c00/0x4c16c38a9b6ceb75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ceb6e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101340:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6ce7d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce7d2 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101352:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb4e00/0x4c16c38a9b6ce929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce922 expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101363:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbe0600/0x4c16c38a9b6ce8b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8b2 expref: 4 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101372:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6ce8d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8ce expref: 3 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101380:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5c00/0x4c16c38a9b6ce8e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6ce8dc expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869580.101391:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e282aaf2800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788869580.101405:0:6512:0:(genops.c:885:class_export_put()) final put ffff8e282aaf2800/8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39 00010000:00010000:1.0:1788869580.101433:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869580.101435:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869580.101437:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788869580.101492:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282aaf2800/8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39 for MGS 00000020:00000080:2.0:1788869580.101536:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282aaf0000 for MGS 00000100:00100000:0.0:1788869580.103034:0:6516:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e282a730c00:6516] 0 exiting: rc = 1 00000100:00100000:0.0:1788869580.103146:0:6518:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e2803edbc00:6518] 1 exiting: rc = 0 00000100:00100000:0.0:1788869580.103211:0:6519:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e2809f45e00:6519] 2 exiting: rc = 0 00000100:00100000:1.0:1788869580.103626:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103636:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103642:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103647:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103652:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103659:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103665:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103687:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103693:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103699:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103705:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103712:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103718:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103724:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103730:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103735:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103740:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103746:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103751:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103758:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103763:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103768:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103774:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103781:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103787:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103792:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103798:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103805:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103811:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103817:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103822:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103828:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103833:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103838:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103845:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103851:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103858:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103864:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103870:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103876:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103882:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103888:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103901:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103907:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103913:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103919:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103925:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103931:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103937:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103943:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103948:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103954:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103959:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103980:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103986:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103992:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.103998:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.104004:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.104010:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.104015:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.104020:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.104026:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.104032:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.104037:0:15109:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869580.106270:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325118464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869580.106366:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869580.106530:0:11289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325118464 00000100:00100000:2.0:1788869580.106540:0:11289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325118464 00000100:00100000:2.0:1788869580.106637:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788869580.106648:0:11289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325118464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869580.106680:0:11289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788869580.106727:0:11289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325118464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869580.106733:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1788869580.106756:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869580.107010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325118464:0@lo:13:osp-pre-0-1.0 00000020:01000000:1.0:1788869580.107520:0:15109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2702788180 - data ffff8e2831f05360/ffff8e282db59400 00000020:01000000:1.0:1788869580.107699:0:15109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2804ffcc60 - data ffff8e2831c915e8/ffff8e282a720400 00000020:00000080:1.0:1788869580.108284:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce39c 00000020:00000080:1.0:1788869580.108294:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e281121a000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788869580.108313:0:15109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e281757b800 from MGS, refs=2 00000020:01000004:1.0:1788869580.108317:0:15109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e281757b800 2 00000020:01000004:1.0:1788869580.108321:0:15109:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e281757b800 from MGS 00000020:00000080:1.0:1788869580.108360:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869580.108368:0:15109:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788869580.108371:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e281121a800/MGS 00000020:00000080:1.0:1788869580.108374:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff8e281121a800/MGS for MGS 00000020:01000000:1.0:1788869580.108382:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1788869580.108560:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e281121a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788869580.108799:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788869580.108804:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869580.108811:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869580.108819:0:15109:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e2817986000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869580.108825:0:15109:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8e28179fb380) has exports, disconnecting them 00000020:00080000:1.0:1788869580.108830:0:15109:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e2817986000), last request at 1788869304 00000020:00000080:1.0:1788869580.108834:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce467 00000020:00080000:1.0:1788869580.108845:0:15109:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2817986000): rc 0 00000020:00000080:1.0:1788869580.108850:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2817986000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788869580.117679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817986000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788869580.118722:0:15109:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788869580.118730:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869580.118747:0:15109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788869580.118754:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869580.118793:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2817985000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788869580.119018:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869580.119029:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788869580.119046:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e2810d5f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788869580.119051:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2810d5f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788869580.119056:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788869580.119169:0:15109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e281757b800 1 00000020:00000080:2.0:1788869580.119176:0:15109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce38e 00000020:00000080:2.0:1788869580.119185:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e281121d800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788869580.119197:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788869580.119206:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e281121d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869580.119215:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869580.119220:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869580.119224:0:15109:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8e282a9319c0) has no exports 00000020:00000080:2.0:1788869580.389202:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869580.389214:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788869580.389220:0:15109:0:(genops.c:885:class_export_put()) final put ffff8e281757e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788869580.389225:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff8e281757e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788869580.389231:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788869580.389376:0:15109:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e281757c800 00000020:02000400:2.0:1788869580.389451:0:15109:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788869581.003365:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869582.021723:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869582.022317:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788869582.150007:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869582.150022:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788869582.150026:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282dac4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869582.150034:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:2.0:1788869582.150040:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788869582.150051:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e282dac4000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869582.150075:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27037c5f80 x1875765325118720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869582.150182:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325118976:0@lo:400:kworker.0 00000100:00100000:2.0:1788869582.150260:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869582.150330:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325119488:0@lo:400:kworker.0 00000100:00100000:2.0:1788869582.150353:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869582.150376:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788869582.150381:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325119104:0@lo:400:kworker.0 00000100:00100000:2.0:1788869582.150400:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869582.150414:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325119616:0@lo:400:kworker.0 00000100:00100000:2.0:1788869582.150436:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869582.150654:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325118592:0@lo:400:kworker.0 00000400:00000100:3.0:1788869582.150681:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765325118592 offset 0 length 224: 4 00000100:00100000:3.0:1788869582.150700:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325119232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869582.150718:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869582.150738:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788869582.150743:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325118848:0@lo:400:kworker.0 00000100:00100000:3.0:1788869582.150763:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869582.150777:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325119360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869582.150796:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869582.150819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325118976 00000100:00100000:3.0:1788869582.150828:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325118976 00000100:00100000:3.0:1788869582.150861:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325119488 00000100:00100000:3.0:1788869582.150864:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325119488 00000100:00100000:3.0:1788869582.150894:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325119104 00000100:00100000:3.0:1788869582.150898:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325119104 00000100:00100000:3.0:1788869582.150911:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325118848 00000100:00100000:3.0:1788869582.150914:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325118848 00000100:00100000:3.0:1788869582.150921:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325119360 00000100:00100000:3.0:1788869582.150923:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325119360 00000100:00100000:3.0:1788869582.150949:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1788869582.150958:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325119488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869582.151024:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325119488:12345-0@lo:400:kworker.0 Request processed in 67us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869582.151032:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1788869582.151059:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1788869582.151065:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325119104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869582.151094:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325119104:12345-0@lo:400:kworker.0 Request processed in 29us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869582.151100:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1788869582.151112:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788869582.151116:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875765325118976:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788869582.151121:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788869582.151145:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875765325118976:12345-0@lo:400:kworker.0 Request processed in 27us (886us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788869582.151151:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788869582.151161:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788869582.151165:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875765325118848:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788869582.151170:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788869582.151195:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875765325118848:12345-0@lo:400:kworker.0 Request processed in 28us (431us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788869582.151200:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788869582.151210:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788869582.151213:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875765325119360:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788869582.151217:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788869582.151237:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875765325119360:12345-0@lo:400:kworker.0 Request processed in 22us (440us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788869582.151242:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1788869582.151256:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869582.151279:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788869582.151283:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8e283b58f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788869582.151286:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788869582.152502:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325118720:0@lo:38:kworker.0 00000100:00100000:1.0:1788869582.152563:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869582.152643:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325118720 00000100:00100000:1.0:1788869582.152652:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325118720 00000100:00100000:1.0:1788869582.152683:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788869582.152689:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325118720:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788869582.152712:0:6530:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788869582.152748:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325118720:12345-0@lo:38:kworker.0 Request processed in 57us (184us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869582.152755:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:1.0:1788869582.152795:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282dac4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869582.152801:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788869582.152804:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325118720:0@lo:38:kworker.0 00010000:00080000:1.0:1788869582.152883:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8e27037c6d80 x1875765325119104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869582.152896:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325119104:0@lo:400:kworker.0 00000100:00080000:1.0:1788869582.152910:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788869582.152914:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e283dfeb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788869582.152917:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788869582.152922:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e283dfeb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869582.152938:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 277 00000100:00080000:1.0:1788869582.152948:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e283dfeb800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869582.152972:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e28179e6300 x1875765325119744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869582.152989:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325118976:0@lo:400:kworker.0 00010000:00080000:1.0:1788869582.153003:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8e282f0bc700 x1875765325119488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869582.155514:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325119488:0@lo:400:kworker.0 00000100:00100000:1.0:1788869582.155609:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325119744:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788869582.155691:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869582.155764:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325119744 00000100:00100000:1.0:1788869582.155774:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325119744 00000100:00100000:1.0:1788869582.155817:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788869582.155825:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765325119744:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788869582.155847:0:6524:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788869582.155910:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765325119744:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 84us (218us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869582.155917:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1788869582.155966:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e283dfeb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869582.155972:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788869582.155975:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325119744:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788869582.157073:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325119616 00000100:00100000:2.0:1788869582.157085:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325119616 00000100:00100000:2.0:1788869582.157153:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325119232 00000100:00100000:2.0:1788869582.157157:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325119232 00000100:00100000:2.0:1788869582.157182:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788869582.157191:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325119616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869582.157285:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325119616:12345-0@lo:400:kworker.0 Request processed in 94us (6846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869582.157292:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788869582.157308:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788869582.157314:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325119232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869582.157343:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325119232:12345-0@lo:400:kworker.0 Request processed in 31us (6625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869582.157349:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1788869582.157523:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869582.157529:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869582.157565:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325119616:0@lo:400:kworker.0 00000100:00080000:3.0:1788869582.191892:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8e283b58f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869582.191909:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 257 00000100:00080000:3.0:1788869582.191935:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e283b58f000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869582.192091:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8c700 x1875765325119872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869582.192121:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325118848:0@lo:400:kworker.0 00000100:00080000:3.0:1788869582.192156:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788869582.192160:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8e27036c3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788869582.192164:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788869582.192168:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8e27036c3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869582.192171:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 300 00000100:00080000:3.0:1788869582.192176:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e27036c3000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869582.192189:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8ce00 x1875765325120000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869582.192200:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325119360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869582.192222:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325119232:0@lo:400:kworker.0 00000100:00100000:1.0:1788869582.196986:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325119872:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788869582.197086:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869582.197316:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325120000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788869582.197347:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869582.197435:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325119872 00000100:00100000:2.0:1788869582.197444:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325119872 00000100:00100000:2.0:1788869582.197489:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325120000 00000100:00100000:2.0:1788869582.197492:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325120000 00000100:00100000:2.0:1788869582.197525:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788869582.197533:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765325119872:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788869582.197580:0:6525:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869582.197649:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765325119872:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 116us (563us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869582.197656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788869582.197671:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788869582.197675:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765325120000:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788869582.197684:0:6525:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869582.197706:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765325120000:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29us (358us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869582.197711:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1788869582.197999:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e283b58f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869582.198005:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788869582.198020:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325119872:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788869582.198032:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27036c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869582.198036:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788869582.198039:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325120000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788869582.662042:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869582.662378:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325120128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869582.662466:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869582.662732:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325120128 00000100:00100000:2.0:1788869582.662743:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325120128 00000100:00100000:2.0:1788869582.662807:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788869582.662817:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325120128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869582.662855:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869582.662999:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325120128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 183us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869582.663006:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788869582.663659:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325120128:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788869583.045905:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869584.072750:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869584.640485:0:15310:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788869584.657956:0:15310:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788869584.658031:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.658053:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.658084:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.658092:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.658120:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788869584.658125:0:15310:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788869584.658155:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869584.658160:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788869584.658169:0:15310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788869584.658177:0:15310:0:(import.c:65:import_set_state_nolock()) ffff8e283b58f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788869584.658182:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869584.658184:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788869584.658187:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788869584.658537:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869584.658546:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869584.658554:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4a00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869584.658559:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869584.658580:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869584.658714:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869584.658721:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788869584.658723:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788869584.658726:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788869584.658762:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869584.658769:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869584.658800:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869584.658808:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6ce8ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce8f1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869584.658820:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869584.658822:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869584.658824:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869584.658836:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869584.658856:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325120256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869584.658946:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869584.659020:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325120256 00000100:00100000:2.0:1788869584.659028:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325120256 00000100:00100000:2.0:1788869584.659068:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869584.659076:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875765325120256:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788869584.659091:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869584 with bad export cookie 5482784596450665400 00010000:00010000:3.0:1788869584.662393:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.662414:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.662422:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.662430:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663621:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869584.663647:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663656:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663663:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663669:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663682:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788869584.663688:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663695:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663701:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663708:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663721:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788869584.663727:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663734:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663747:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663754:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869584.663762:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788869584.663766:0:15310:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788869584.663813:0:15310:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788869584.663818:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788869584.663822:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869584.663829:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788869584.663836:0:15310:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8e283dfea800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788869584.663842:0:15310:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8e2701f1f800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788869584.663847:0:15310:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8e283b5799c0) has exports, disconnecting them 00000020:00080000:3.0:1788869584.663851:0:15310:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e283dfea800), last request at 1788869582 00000020:00000080:3.0:1788869584.663858:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce79a 00000100:00080000:3.0:1788869584.663888:0:15310:0:(import.c:65:import_set_state_nolock()) ffff8e283dfed000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788869584.663951:0:15310:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e283dfea800): rc 0 00000020:00000080:3.0:1788869584.663954:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e283dfea800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788869584.663965:0:15310:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e2701f1f800), last request at 1788869582 00000020:00000080:3.0:1788869584.663968:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce674 00000100:00080000:3.0:1788869584.663974:0:15310:0:(import.c:65:import_set_state_nolock()) ffff8e2701f19800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788869584.663985:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283dfea800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788869584.664032:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e283dfed000 for lustre-MDT0001 00000020:00080000:3.0:1788869584.664045:0:15310:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2701f1f800): rc 0 00000020:00000080:3.0:1788869584.664047:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e2701f1f800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788869584.664065:0:15310:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb9f681c6fae0 00000020:00000080:3.0:1788869584.664079:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2701f1f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788869584.664102:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2701f19800 for lustre-MDT0001 00000100:00080000:3.0:1788869584.664129:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869584.664140:0:15310:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8e2703baaa00 x1875765325118208/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788869595 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869584.664162:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1788869584.664948:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788869584.664962:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.664986:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbe00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869584.664989:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.664998:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869584.665005:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869584.665011:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869584.665014:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1788869584.665017:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1788869584.665056:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665063:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869584.665081:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665088:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edbe00/0x4c16c38a9b6ce8f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce8ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665101:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788869584.665105:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665111:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8c00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869584.665114:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665128:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869584.665135:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869584.665140:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869584.665142:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788869584.665144:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788869584.665156:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665162:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869584.665168:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665175:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8c00/0x4c16c38a9b6ce7d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce7d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665189:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869584.665193:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665199:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869584.665203:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665210:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869584.665226:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869584.665232:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788869584.665234:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788869584.665236:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788869584.665250:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665255:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869584.665270:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665277:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6ceb6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ceb75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665285:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869584.665289:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665295:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869584.665297:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665304:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869584.665310:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869584.665324:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869584.665326:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788869584.665328:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788869584.665341:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665347:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869584.665353:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665360:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2800031600/0x4c16c38a9b6ce4bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6ce4c2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869584.665373:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869584.665375:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869584.665377:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869584.665386:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869584.665866:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325120512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869584.665956:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869584.666013:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869584.666020:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325120384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869584.666042:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869584.666246:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325120512 00000100:00100000:1.0:1788869584.666254:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325120512 00000100:00100000:1.0:1788869584.666282:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325120384 00000100:00100000:1.0:1788869584.666284:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325120384 00000100:00100000:1.0:1788869584.666297:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869584.666305:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2803e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875765325120512:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788869584.666311:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869584 with bad export cookie 5482784596450665400 00000100:00100000:1.0:1788869584.666368:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2803e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875765325120512:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (411us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788869584.666376:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869584.666393:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869584.666397:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875765325120384:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788869584.666401:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869584 with bad export cookie 5482784596450665400 00000100:00100000:1.0:1788869584.666426:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875765325120384:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (382us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788869584.666431:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788869584.668650:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788869584.668658:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8e2808343000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788869584.668663:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788869584.669076:0:15310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788869584.669085:0:15310:0:(import.c:65:import_set_state_nolock()) ffff8e282dac4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788869584.669343:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788869584.669348:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788869584.669364:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788869584.669427:0:15310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788869584.671101:0:15310:0:(import.c:65:import_set_state_nolock()) ffff8e283b46d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788869584.671141:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788869584.671146:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788869584.671161:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788869584.671392:0:15310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788869584.671406:0:15310:0:(import.c:65:import_set_state_nolock()) ffff8e283b46d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788869584.671445:0:15310:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e283b5799c0) has no exports 00000100:00100000:3.0:1788869584.674161:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325118208:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869584.674241:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869584.677004:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875765325120256:12345-0@lo:103:ldlm_bl.0 Request processed in 17921us (18051us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788869584.677017:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788869584.690957:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.154@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788869584.690964:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788869584.690975:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e27037c5500 x1875765325118592/t0(0) o400->MGC192.168.204.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788869598 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869584.690991:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e282f0be300 x1875765325120256/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869600 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869584.691000:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e28179e4e00 x1875765325120512/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869600 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869584.691009:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e28179e4a80 x1875765325120384/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869600 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788869584.691019:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788869584.691021:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788869584.691023:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788869584.691144:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:0:1875765325120768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869584.691657:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325120896:0@lo:9:umount.0 00000100:00100000:2.0:1788869584.691744:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869584.691789:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325121024:0@lo:9:umount.0 00000100:00100000:2.0:1788869584.691811:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869584.691852:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325120896 00000100:00100000:2.0:1788869584.691861:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325120896 00000100:00100000:2.0:1788869584.691931:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325121024 00000100:00100000:2.0:1788869584.691936:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325121024 00000100:00100000:2.0:1788869584.691965:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788869584.691975:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765325120896:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788869584.692015:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce6c1 00000100:00080000:2.0:1788869584.692026:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8e2702743800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869584.692078:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788869584.693067:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3647:x1875765325120896:12345-0@lo:9:umount.0 Request processed in 1088us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869584.693077:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788869584.693098:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788869584.693106:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765325121024:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788869584.693124:0:8440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce803 00000100:00080000:2.0:1788869584.693132:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8e282dba8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869584.693162:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788869584.693238:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3647:x1875765325121024:12345-0@lo:9:umount.0 Request processed in 133us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869584.693265:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1788869584.693320:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e283b46d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788869584.693332:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788869584.693335:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788869584.693339:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325120896:0@lo:9:umount.0 00000100:00080000:2.0:1788869584.693350:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e283b46d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788869584.693360:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788869584.693361:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788869584.693363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325121024:0@lo:9:umount.0 00000100:00100000:3.0:1788869584.694136:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:0:1875765325120640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869584.694335:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325120256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869584.694347:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3650:1875765325118592:0@lo:400:kworker.0 00000100:00080000:0.0:1788869584.694727:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869584.694733:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869584.694806:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869584.694902:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8e2808343000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869584.694910:0:3649:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 238 00000100:00080000:1.0:1788869584.694923:0:3649:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8e2808343000 using connection 192.168.204.154@tcp/0@lo 00010000:00010000:1.0:1788869584.694937:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869584.694975:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e28179e5c00 x1875765325121152/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869584.695007:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325120512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869584.695022:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3649:1875765325120384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869584.695076:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3647:1875765325121152:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788869584.695140:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765325121152 offset 0 length 520: 4 00000020:00080000:2.0:1788869584.704728:0:15310:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e283b5799c0) has no exports 00000020:01000000:0.0:1788869584.794764:0:15310:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2702a53840 - data ffff8e280aada948/ffff8e2840ec8c00 00000020:01000000:0.0:1788869584.794951:0:15310:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e282a76e300 - data ffff8e2831e52870/ffff8e282daaf400 00000001:00000004:1.0:1788869584.807727:0:15310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788869584.877869:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869584.877890:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788869584.877900:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788869584.884191:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788869584.884200:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1788869584.884349:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788869584.884380:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788869584.884954:0:8726:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788869584.884959:0:8726:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1788869584.884991:0:8726:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788869584.888909:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788869584.888920:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1788869584.888972:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788869584.888976:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788869584.889798:0:9788:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788869584.889805:0:9788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1788869584.889838:0:9788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788869584.892830:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce4de 00000020:00000080:1.0:1788869584.892845:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e282db00800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788869584.897002:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce4f3 00000020:00000080:1.0:1788869584.897023:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e283b58e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788869584.898246:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db00800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788869584.899082:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788869584.899095:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869584.899108:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788869584.899113:0:15310:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8e283b57cd40) has no exports 00000004:01000000:1.0:1788869584.899832:0:15310:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788869584.899846:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce7fc 00000020:00000080:1.0:1788869584.899855:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e282dba8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869584.899913:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283b58e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788869584.900047:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788869584.900053:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869584.900063:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788869584.900068:0:15310:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8e28411e4d40) has no exports 00000020:00000080:1.0:1788869584.900076:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce7f5 00000020:00000080:1.0:1788869584.900094:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e2702745000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788869584.900112:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282dba8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1788869584.901790:0:15310:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788869584.901799:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788869584.901804:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788869584.901812:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788869584.901815:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869584.901887:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2702745000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788869584.902067:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869584.902082:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788869584.902095:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce6ba 00000020:00000080:1.0:1788869584.902106:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e2702743000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869584.902127:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e283b46d000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788869584.902134:0:8:0:(genops.c:885:class_export_put()) final put ffff8e27029ec800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869584.902137:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029ec800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788869584.902142:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788869584.904257:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788869584.904272:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869584.904286:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788869584.904292:0:15310:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8e2840d84d40) has no exports 00000020:00000080:1.0:1788869584.904303:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce6b3 00000020:00000080:1.0:1788869584.904312:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e283b468800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788869584.904819:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2702743000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1788869584.906245:0:15310:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788869584.906254:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788869584.906259:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788869584.906268:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788869584.906271:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869584.906671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283b468800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788869584.906861:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869584.906883:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788869584.906906:0:15310:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788869584.906914:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce516 00000020:00000080:1.0:1788869584.906924:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e2840b9d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869584.906953:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e283b46d800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788869584.907081:0:8:0:(genops.c:885:class_export_put()) final put ffff8e2702744000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869584.907084:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2702744000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788869584.907089:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788869584.907731:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788869584.907738:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869584.907745:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788869584.907750:0:15310:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8e2840a38000) has no exports 00000020:00000080:1.0:1788869584.907757:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce50f 00000020:00000080:1.0:1788869584.907762:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e282dac7000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788869584.907924:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840b9d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788869584.910123:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282dac7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788869584.921139:0:15310:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788869584.921154:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869584.921160:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788869584.921171:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869584.921328:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869584.921409:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869584.921569:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869584.921574:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869584.921580:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e282db01800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788869584.921602:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db01800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788869584.921619:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869584.921900:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282dac4000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788869584.921909:0:8:0:(genops.c:885:class_export_put()) final put ffff8e282dac2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869584.921911:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282dac2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788869584.921917:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869584.923780:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce4fa 00000020:00000080:2.0:1788869584.923798:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e283b588800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788869584.923822:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788869584.923885:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869584.923895:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788869584.923901:0:15310:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8e283b57b380) has no exports 00000020:00000080:2.0:1788869584.923930:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869584.923937:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788869584.923942:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce501 00000020:00000080:2.0:1788869584.923946:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e283b58d800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788869584.923975:0:15310:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e282daf5000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788869584.923980:0:15310:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e282daf5000 2 00000020:01000004:2.0:1788869584.923983:0:15310:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e282daf5000 from lustre-MDT0001 00000020:00000080:2.0:1788869584.924005:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869584.924009:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788869584.924012:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e282db05800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788869584.924015:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db05800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788869584.924027:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788869584.924076:0:15310:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788869584.924081:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788869584.924084:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869584.924087:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788869584.924094:0:15310:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8e2840c49000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869584.924099:0:15310:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8e283b578000) has exports, disconnecting them 00000020:00080000:2.0:1788869584.924104:0:15310:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8e2840c49000), last request at 1788869323 00000020:00000080:2.0:1788869584.924108:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce555 00000020:00080000:2.0:1788869584.924118:0:15310:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2840c49000): rc 0 00000020:00000080:2.0:1788869584.924122:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e2840c49000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788869584.925121:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283b588800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788869584.925135:0:8:0:(genops.c:885:class_export_put()) final put ffff8e282db01000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788869584.925154:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db01000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788869584.925165:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788869584.925636:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283b58d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788869584.925642:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c49000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788869584.928702:0:15310:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788869584.928713:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869584.928718:0:15310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788869584.928728:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869584.928765:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e283b58f000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788869584.931086:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869584.931105:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788869584.931113:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e283b58b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788869584.931118:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283b58b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788869584.931128:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788869584.931220:0:15310:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e282daf5000 1 00000020:00000080:3.0:1788869584.931238:0:15310:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce491 00000020:00000080:3.0:1788869584.931246:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e282daf7800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788869584.931264:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788869584.931284:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282daf7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788869584.931298:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869584.931303:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788869584.931307:0:15310:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8e28179f8000) has no exports 00010000:00010000:2.0:1788869585.199077:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788869585.204506:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869585.204521:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788869585.204526:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e282daf1800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788869585.204531:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282daf1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788869585.204712:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788869585.204837:0:15310:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e282daf4800 00000020:01000000:3.0:1788869585.204862:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788869585.204875:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869585.204889:0:15310:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788869585.204894:0:15310:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8e282a930000) has no exports 00000100:00100000:0.0:1788869585.206728:0:8260:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8e2803e0a200:8260] 3 exiting: rc = 0 00000100:00100000:0.0:1788869585.210800:0:6526:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8e282a93de00:6526] 2 exiting: rc = 0 00000100:00100000:2.0:1788869585.210982:0:6525:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8e282a730a00:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1788869585.212447:0:6524:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8e282a743200:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1788869585.212918:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212928:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212935:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212942:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212949:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212956:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212963:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212969:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212974:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212981:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212987:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212993:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.212999:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213005:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213013:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213020:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213027:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213033:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213040:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213048:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213053:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213059:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213065:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213072:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213078:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213083:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213088:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213094:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213098:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213103:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213108:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213114:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213119:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213152:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213159:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213165:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213171:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213177:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213182:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213188:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213195:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213200:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213206:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213212:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213216:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213221:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213226:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213232:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213237:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213242:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213247:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213252:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213258:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213263:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213269:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213274:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213280:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213285:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213290:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213296:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213301:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213307:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213313:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.213320:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.222537:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e280a71ee00:6527] 0 exiting: rc = 1 00000100:00100000:1.0:1788869585.222844:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e280a71e000:6528] 1 exiting: rc = 0 00000100:00100000:3.0:1788869585.222945:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.222956:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.222962:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.222984:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.222990:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.222996:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223001:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223006:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223010:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223016:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223022:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223027:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223034:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223039:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223044:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223048:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223053:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223057:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223063:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223068:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223073:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223078:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223083:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223088:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223092:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223098:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223103:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223109:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223113:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223118:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223123:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223128:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223133:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223137:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223142:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223147:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223152:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223158:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223170:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223175:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223180:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223185:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223191:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223196:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223201:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223206:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223212:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223216:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223222:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223227:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223232:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223238:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223244:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223249:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223255:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223260:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223265:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223269:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223274:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223279:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223284:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223288:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223293:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.223298:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.229058:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8e280a71fa00:6529] 0 exiting: rc = 1 00000100:00100000:2.0:1788869585.229329:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8e2813000e00:6530] 1 exiting: rc = 0 00000100:00100000:0.0:1788869585.232017:0:7831:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8e2804cf3000:7831] 2 exiting: rc = 0 00000100:00100000:3.0:1788869585.232229:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232242:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232280:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232290:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232298:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232306:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232314:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232321:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232327:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232348:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232355:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232364:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232370:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232376:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232398:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232407:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232413:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232418:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232424:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232430:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232436:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232443:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232452:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232459:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232469:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232476:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232513:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232522:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232529:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232536:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232544:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232551:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232557:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232563:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232571:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232581:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232611:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232619:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232640:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232647:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232653:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232659:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232664:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232670:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232681:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232686:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232693:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232921:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232927:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232933:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232954:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232961:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232968:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232974:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232981:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232987:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.232994:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.233001:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.233008:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.233014:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.233020:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.233027:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.233034:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869585.233048:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.251198:0:6532:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e282798f600:6532] 1 exiting: rc = 0 00000100:00100000:0.0:1788869585.251363:0:6531:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e282798fa00:6531] 0 exiting: rc = 1 00000100:00100000:2.0:1788869585.251467:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251474:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251480:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251499:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251505:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251511:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251516:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251520:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251525:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251530:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251534:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251538:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251543:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251548:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251553:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251557:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251562:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251567:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251572:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251576:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251581:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251721:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251730:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251735:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251741:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251746:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251751:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251756:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251761:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251766:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251771:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251776:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251781:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251787:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251793:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251798:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251803:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251807:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251821:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251826:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251832:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251837:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251842:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251847:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251852:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251856:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251861:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251887:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251892:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251897:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251902:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251907:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251912:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251917:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251921:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251925:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251930:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251934:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251939:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251944:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251949:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251954:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251959:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.251965:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.254677:0:6534:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e280a6b3e00:6534] 1 exiting: rc = 0 00000100:00100000:2.0:1788869585.255298:0:6533:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e282798e000:6533] 0 exiting: rc = 1 00000100:00100000:1.0:1788869585.259012:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259024:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259030:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259035:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259041:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259046:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259052:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259057:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259062:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259067:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259072:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259078:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259083:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259088:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259094:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259099:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259106:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259111:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259118:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259123:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259129:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259134:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259139:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259144:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259149:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259154:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259159:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259164:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259168:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259194:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259199:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259204:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259210:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259215:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259220:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259228:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259233:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259237:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259243:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259248:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259253:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259259:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259265:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259271:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259277:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259281:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259287:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259293:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259299:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259304:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259310:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259315:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259320:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259325:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259331:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259337:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259341:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259346:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259351:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259356:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259362:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259367:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259373:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869585.259378:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.264365:0:6536:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e2829a29e00:6536] 1 exiting: rc = 0 00000100:00100000:0.0:1788869585.264705:0:6535:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e280a711e00:6535] 0 exiting: rc = 1 00000100:00100000:2.0:1788869585.268395:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268409:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268415:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268420:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268425:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268430:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268436:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268461:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268466:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268472:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268477:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268482:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268488:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268493:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268499:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268504:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268508:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268513:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268519:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268524:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268529:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268534:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268539:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268544:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268549:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268553:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268558:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268564:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268568:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268574:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268579:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268584:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268617:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268622:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268627:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268632:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268637:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268642:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268646:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268651:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268656:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268661:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268673:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268678:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268683:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268688:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268705:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268711:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268716:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268721:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268726:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268731:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268735:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268740:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268744:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268749:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268753:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268759:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268764:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268768:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268773:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268778:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268783:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.268788:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869585.269390:0:6539:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8e2829a28e00:6539] 2 exiting: rc = 0 00000100:00100000:2.0:1788869585.269623:0:6538:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8e2829a29a00:6538] 1 exiting: rc = 0 00000100:00100000:3.0:1788869585.269952:0:6537:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8e2803e0b400:6537] 0 exiting: rc = 1 00000100:00100000:0.0:1788869585.270158:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270166:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270173:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270179:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270184:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270190:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270195:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270201:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270206:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270213:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270221:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270226:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270232:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270238:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270243:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270248:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270254:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270259:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270280:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270286:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270293:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270299:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270305:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270310:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270327:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270332:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270338:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270343:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270349:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270354:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270361:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270367:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270373:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270378:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270385:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270391:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270396:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270401:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270407:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270412:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270418:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270423:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270443:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270451:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270456:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270462:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270468:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270473:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270478:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270484:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270491:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270497:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270503:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270511:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270519:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270525:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270531:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270537:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270543:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270558:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270563:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270569:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270575:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869585.270580:0:15310:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788869585.278339:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869585.278360:0:15310:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788869585.278367:0:15310:0:(genops.c:885:class_export_put()) final put ffff8e2808344800/MDS_uuid 00000020:00000080:0.0:1788869585.278373:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2808344800/MDS_uuid for MDS 00000020:01000000:0.0:1788869585.278380:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788869585.278544:0:15310:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788869586.250619:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869587.270810:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869587.270820:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869587.270836:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869587.270840:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788869587.270845:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e283dfeb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869587.270856:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 516 00000100:00080000:3.0:1788869587.270863:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869587.270878:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e283dfeb800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869587.270913:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8c000 x1875765325121280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869587.270985:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869587.270989:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788869587.270991:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e27036c3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869587.270995:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 516 00000100:00080000:3.0:1788869587.270998:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869587.271002:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e27036c3000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869587.271013:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8ea00 x1875765325121536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869587.271175:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325121408:0@lo:400:kworker.0 00000400:00000100:3.0:1788869587.271231:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325121408 offset 0 length 224: 4 00000100:00100000:3.0:1788869587.271286:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869587.271293:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325121664:0@lo:400:kworker.0 00000400:00000100:3.0:1788869587.271312:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325121664 offset 0 length 224: 4 00000100:00100000:2.0:1788869587.271462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325121280:0@lo:38:kworker.0 00000400:00000100:2.0:1788869587.271490:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325121280 offset 0 length 520: 4 00000100:00100000:2.0:1788869587.271512:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325121536:0@lo:38:kworker.0 00000400:00000100:2.0:1788869587.271528:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325121536 offset 0 length 520: 4 00010000:00010000:2.0:1788869587.273383:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869588.293838:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788869589.201305:0:15511:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788869589.223865:0:15511:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788869589.223925:0:15511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869589.223941:0:15511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869589.223950:0:15511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869589.223956:0:15511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869589.223977:0:15511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788869589.223983:0:15511:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788869589.224013:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869589.224026:0:15511:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2703a8c000 x1875765325121280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869602 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869589.224051:0:15511:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788869589.224058:0:15511:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788869589.224066:0:15511:0:(import.c:65:import_set_state_nolock()) ffff8e283dfeb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788869589.224072:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869589.224076:0:15511:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2703a8c000 x1875765325121280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869602 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869589.224083:0:15511:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788869589.224086:0:15511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1788869589.224301:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325121280:0@lo:38:kworker.0 00010000:00010000:3.0:1788869589.225803:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869589.225818:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869589.225830:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869589.225835:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869589.225845:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869589.225852:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869589.225875:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869589.225877:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788869589.225880:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788869589.225972:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2808343000 00010000:00010000:3.0:1788869589.225977:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869589.225984:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f600/0x4c16c38a9b6ce8ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce8d5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869589.226064:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869589.226067:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869589.226069:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869589.226477:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788869589.226490:0:15511:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2703a8d880 x1875765325121408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869603 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869589.226668:0:15511:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788869589.226676:0:15511:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788869589.226707:0:15511:0:(import.c:65:import_set_state_nolock()) ffff8e2702741800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788869589.226816:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765325121792:0@lo:39:umount.0 00000400:00000100:2.0:1788869589.226878:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325121792 offset 0 length 224: 4 00000100:00100000:3.0:1788869589.228282:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325121408:0@lo:400:kworker.0 00000100:00080000:2.0:1788869589.317880:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869589.317893:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869589.317896:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869589.317900:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869589.318258:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325121920:0@lo:400:kworker.0 00000400:00000100:3.0:1788869589.318326:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325121920 offset 0 length 224: 4 00010000:00010000:2.0:1788869589.323190:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788869589.842366:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788869589.842378:0:9520:0:(genops.c:885:class_export_put()) final put ffff8e282dbad800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788869589.842724:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282dbad800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788869589.845247:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282dba8000 for lustre-OST0001 00000001:00100000:2.0:1788869589.848939:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788869589.848950:0:8435:0:(genops.c:885:class_export_put()) final put ffff8e2702740000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788869589.850495:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2702740000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788869589.850561:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2702743800 for lustre-OST0000 00010000:00010000:2.0:1788869590.342995:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869591.368479:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869592.327809:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869592.327820:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869592.327824:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869592.327827:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869592.327999:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869592.328019:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325122048:0@lo:400:kworker.0 00000400:00000100:2.0:1788869592.328086:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325122048 offset 0 length 224: 4 00010000:00010000:2.0:1788869592.391526:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869593.417123:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869594.374628:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869584/real 1788869584] req@ffff8e28179e5c00 x1875765325121152/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869594 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869594.374668:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e28179e5c00 x1875765325121152/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869594 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869594.374700:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2808343000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869594.374731:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788869594.374735:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3647:1875765325121152:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1788869594.374818:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869594.374823:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788869594.374826:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2808343000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869594.374831:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 518 00000100:00080000:3.0:1788869594.374856:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869594.374867:0:36:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8e2808343000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869594.374900:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8e680 x1875765325122176/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869594.374925:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869594.374929:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869594.375127:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3647:1875765325122176:0@lo:250:kworker.0 00000400:00000100:0.0:1788869594.375173:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765325122176 offset 0 length 520: 4 00000100:00100000:2.0:1788869594.376861:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869594.376885:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325122304:0@lo:400:kworker.0 00000400:00000100:2.0:1788869594.376945:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325122304 offset 0 length 224: 4 00010000:00010000:3.0:1788869594.442516:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869595.461934:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869596.485841:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869597.511340:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869598.533966:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869599.493744:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869589/real 1788869589] req@ffff8e28179e4a80 x1875765325121792/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869599 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869599.493779:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e28179e4a80 x1875765325121792/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869599 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869599.493820:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2702741800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788869599.493843:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765325121792:0@lo:39:umount.0 00000100:00080000:1.0:1788869599.493900:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788869599.493906:0:15511:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788869599.493912:0:15511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788869599.494852:0:15511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869599.494870:0:15511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869599.494877:0:15511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869599.494885:0:15511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869599.494978:0:15511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869599.494987:0:15511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869599.494994:0:15511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869599.495000:0:15511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869599.495017:0:15511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869599.498644:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869599.498665:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869599.498677:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7fe00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869599.498704:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869599.498716:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869599.498725:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869599.498732:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788869599.498736:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788869599.498752:0:6513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2808343000 00010000:00010000:2.0:1788869599.498756:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869599.498763:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fe00/0x4c16c38a9b6ce8dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce8e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869599.498782:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869599.498786:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869599.498792:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe1200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869599.498796:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869599.498802:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869599.498809:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869599.498825:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788869599.498827:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788869599.498832:0:6513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2808343000 00010000:00010000:2.0:1788869599.498836:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869599.498843:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869599.498845:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869599.498847:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869599.505046:0:15511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788869599.505064:0:15511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1200/0x4c16c38a9b6ceb60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ceb67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869599.505088:0:15511:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788869599.505103:0:15511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788869599.505105:0:15511:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788869599.505163:0:15511:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788869599.505167:0:15511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788869599.505177:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869599.505184:0:15511:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788869599.505188:0:15511:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8e2802bd19c0) has no exports 00000020:00080000:1.0:1788869599.505215:0:15511:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8e2802bd19c0) has no exports 00000020:01000000:1.0:1788869599.507036:0:15511:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2827aaf840 - data ffff8e2831f05438/ffff8e282db58400 00000020:01000000:1.0:1788869599.507167:0:15511:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e270244dba0 - data ffff8e2831ee0000/ffff8e270259f800 00010000:00010000:3.0:1788869599.507555:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788869599.517575:0:15511:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788869599.549717:0:15511:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce62e 00000020:00000080:2.0:1788869599.549730:0:15511:0:(genops.c:885:class_export_put()) final put ffff8e283dfea000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788869599.549787:0:15511:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e283b46c800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788869599.549792:0:15511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e283b46c800 2 00000020:01000004:2.0:1788869599.549795:0:15511:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e283b46c800 from lustre-OST0000 00000020:00000080:2.0:1788869599.549819:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869599.549829:0:15511:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788869599.549832:0:15511:0:(genops.c:885:class_export_put()) final put ffff8e283dfef800/lustre-OST0000_UUID 00000020:00000080:2.0:1788869599.549835:0:15511:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283dfef800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788869599.549842:0:15511:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788869599.549899:0:15511:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788869599.549903:0:15511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788869599.549907:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869599.549911:0:15511:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788869599.549917:0:15511:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e2840c48800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869599.549923:0:15511:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8e27025eb380) has exports, disconnecting them 00000020:00080000:2.0:1788869599.549929:0:15511:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e2840c48800), last request at 1788869344 00000020:00000080:2.0:1788869599.549932:0:15511:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce658 00000020:00080000:2.0:1788869599.549942:0:15511:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2840c48800): rc 0 00000020:00000080:2.0:1788869599.549947:0:15511:0:(genops.c:885:class_export_put()) final put ffff8e2840c48800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788869599.553028:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283dfea000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788869599.555889:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c48800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:00010000:2.0:1788869599.558665:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788869599.558710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869599.558717:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869599.558720:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869599.558724:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869599.558843:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869599.558866:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325122432:0@lo:400:kworker.0 00000400:00000100:0.0:1788869599.558924:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325122432 offset 0 length 224: 4 00010000:01000000:0.0:1788869599.564310:0:15511:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788869599.564323:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788869599.564328:0:15511:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788869599.564335:0:15511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788869599.564550:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869599.564561:0:15511:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788869599.564567:0:15511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788869599.564575:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869599.564614:0:15511:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788869599.564623:0:15511:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8e2702741000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869599.564629:0:15511:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8e2840d80000) has exports, disconnecting them 00000020:00080000:0.0:1788869599.564633:0:15511:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8e2702741000), last request at 1788869344 00000020:00000080:0.0:1788869599.564638:0:15511:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce66d 00000020:00080000:0.0:1788869599.564666:0:15511:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2702741000): rc 0 00000020:00000080:0.0:1788869599.564671:0:15511:0:(genops.c:885:class_export_put()) final put ffff8e2702741000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788869599.565279:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e283dfeb800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788869599.565291:0:36:0:(genops.c:885:class_export_put()) final put ffff8e283dfef000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788869599.565294:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283dfef000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788869599.565308:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788869599.565375:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2702741000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788869599.582948:0:15511:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788869599.582960:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869599.582965:0:15511:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788869599.582974:0:15511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869599.583007:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2702741800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788869599.583241:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869599.583250:0:15511:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788869599.583255:0:15511:0:(genops.c:885:class_export_put()) final put ffff8e2840c4d800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788869599.583259:0:15511:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788869599.583265:0:15511:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788869599.583354:0:15511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e283b46c800 1 00000020:00000080:2.0:1788869599.583361:0:15511:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce5f6 00000020:00000080:2.0:1788869599.583370:0:15511:0:(genops.c:885:class_export_put()) final put ffff8e282db04800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788869599.583378:0:15511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788869599.583387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db04800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788869599.583396:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869599.583401:0:15511:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869599.583405:0:15511:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8e2840d83380) has no exports 00000020:00000080:2.0:1788869599.643915:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869599.643932:0:15511:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788869599.643938:0:15511:0:(genops.c:885:class_export_put()) final put ffff8e283b46b800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788869599.643944:0:15511:0:(genops.c:844:class_export_destroy()) destroying export ffff8e283b46b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788869599.643958:0:15511:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788869599.644098:0:15511:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e283b46f800 00000020:02000400:2.0:1788869599.645455:0:15511:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788869600.583500:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869601.607232:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869602.576410:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869587/real 1788869587] req@ffff8e2703a8ea00 x1875765325121536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788869602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869602.576450:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2703a8ea00 x1875765325121536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788869602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869602.576471:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27036c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869602.576502:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788869602.576507:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325121536:0@lo:38:kworker.0 00000100:00080000:2.0:1788869602.576649:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869602.576655:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869602.576657:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869602.576661:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788869602.576664:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e27036c3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869602.576670:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 521 00000100:00080000:2.0:1788869602.576676:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788869602.576689:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e27036c3000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869602.576730:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f0bd880 x1875765325122560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869602.576794:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325122560:0@lo:38:kworker.0 00000400:00000100:2.0:1788869602.576850:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325122560 offset 0 length 520: 4 00000100:00100000:2.0:1788869602.576918:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325122688:0@lo:400:kworker.0 00000400:00000100:2.0:1788869602.576939:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325122688 offset 0 length 224: 4 00010000:00010000:1.0:1788869602.630778:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788869603.654413:0:15713:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000100:00000400:3.0:1788869603.662017:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869587/real 1788869587] req@ffff8e2703a8df80 x1875765325121664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788869603.669686:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869603.682137:0:3648:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8e2703a8df80 x1875765325121664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869603.682154:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e282dac5800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788869603.682159:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788869603.699225:0:3648:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1788869603.699289:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325121664:0@lo:400:kworker.0 00000100:00080000:1.0:1788869603.699644:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869603.699651:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869603.699653:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869603.699656:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869603.699658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869603.699679:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788869603.699682:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e282dac5800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869603.699688:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 301 00000100:00080000:1.0:1788869603.699703:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e282dac5800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869603.699738:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e28179e4e00 x1875765325122816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869603.700111:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765325122816:0@lo:38:kworker.0 00000400:00000100:3.0:1788869603.700168:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325122816 offset 0 length 520: 4 00000020:01000004:1.0:1788869603.700813:0:15713:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788869603.700901:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.700915:0:15713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.700922:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.700929:0:15713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.700949:0:15713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788869603.700955:0:15713:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788869603.700979:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869603.700987:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e282f0bd880 x1875765325122560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869622 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869603.701008:0:15713:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788869603.701014:0:15713:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788869603.701021:0:15713:0:(import.c:65:import_set_state_nolock()) ffff8e27036c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788869603.701027:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869603.701043:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e282f0bd880 x1875765325122560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869622 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869603.701050:0:15713:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788869603.701053:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:3.0:1788869603.701136:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325122560:0@lo:38:kworker.0 00010000:00010000:0.0:1788869603.701306:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869603.701315:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869603.701324:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869603.701328:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869603.701338:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869603.701345:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869603.701352:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869603.701354:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788869603.701357:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788869603.701370:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2808343000 00010000:00010000:0.0:1788869603.701373:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869603.701388:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6ce8b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce8b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869603.701400:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869603.701402:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869603.701403:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869603.703412:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788869603.703431:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e282f0bf100 x1875765325121920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869603.703458:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2703a8d880 x1875765325122048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869608 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869603.703466:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2703a8f100 x1875765325122304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869610 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869603.703569:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e27028a1500 x1875765325122432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869615 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869603.703660:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325122048:0@lo:400:kworker.0 00000100:00100000:2.0:1788869603.703715:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325122304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869603.703748:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e282f0bfb80 x1875765325122688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869618 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869603.703757:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e28179e4e00 x1875765325122816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869613 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869603.703773:0:15713:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788869603.703800:0:15713:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788869603.705105:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325122432:0@lo:400:kworker.0 00000100:00100000:0.0:1788869603.709776:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325121920:0@lo:400:kworker.0 00000100:00100000:0.0:1788869603.709832:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325122688:0@lo:400:kworker.0 00000100:00080000:1.0:1788869603.712457:0:15713:0:(import.c:65:import_set_state_nolock()) ffff8e282dac5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788869603.712578:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788869603.712638:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e27028a1500 x1875765325122432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869615 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869603.712654:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e28179e4e00 x1875765325122816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869613 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869603.712664:0:15713:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788869603.712669:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:2.0:1788869603.714050:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765325122816:0@lo:38:kworker.0 00010000:00010000:1.0:1788869603.716655:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.716678:0:15713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.716686:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.716693:0:15713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.716780:0:15713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869603.716789:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.716796:0:15713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.716803:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869603.716809:0:15713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869603.717155:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869603.717164:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869603.717172:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbe1e00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869603.717191:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869603.717200:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869603.717207:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869603.717212:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788869603.717214:0:7475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788869603.717226:0:7475:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2808343000 00010000:00010000:2.0:1788869603.717230:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869603.717237:0:7475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1e00/0x4c16c38a9b6ce8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce8c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869603.717252:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869603.717254:0:7475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869603.717260:0:7475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869603.717262:0:7475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869603.717268:0:7475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869603.717273:0:7475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869603.717287:0:7475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788869603.717289:0:7475:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788869603.717293:0:7475:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2808343000 00010000:00010000:2.0:1788869603.717296:0:7475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869603.717302:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869603.717303:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869603.717305:0:7475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869603.717462:0:15713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788869603.717466:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6ceb52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ceb59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869603.717493:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788869603.717516:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788869603.717519:0:15713:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788869603.717557:0:15713:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788869603.717562:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788869603.717568:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869603.717576:0:15713:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788869603.717580:0:15713:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8e27025ecd40) has no exports 00000020:00080000:1.0:1788869603.717631:0:15713:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8e27025ecd40) has no exports 00010000:00010000:2.0:1788869603.720441:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788869603.720748:0:15713:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2840fddde0 - data ffff8e2702071d80/ffff8e282db5b400 00000020:01000000:0.0:1788869603.720914:0:15713:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2827aaf4e0 - data ffff8e2702025ca8/ffff8e270391b000 00100000:10000000:2.0:1788869603.735482:0:15713:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788869603.749351:0:15713:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce754 00000020:00000080:3.0:1788869603.749375:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e2703412800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788869603.749415:0:15713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e27029d7800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788869603.749419:0:15713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e27029d7800 2 00000020:01000004:3.0:1788869603.749423:0:15713:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e27029d7800 from lustre-OST0001 00000020:00000080:3.0:1788869603.749461:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869603.749472:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788869603.749475:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e2703416800/lustre-OST0001_UUID 00000020:00000080:3.0:1788869603.749479:0:15713:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703416800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788869603.749487:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788869603.749667:0:15713:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39->MGS 00010000:00010000:3.0:1788869603.749691:0:15713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6ce4ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce4b4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869603.749706:0:15713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6ce4ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce4b4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869603.749713:0:15713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788869603.749717:0:15713:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788869603.749722:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788869603.749742:0:15713:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2808343000 00010000:00010000:3.0:1788869603.749746:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6ce4ad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce4b4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869603.749763:0:15713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6ce929 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869603.749770:0:15713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6ce929 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869603.749775:0:15713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869603.749777:0:15713:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788869603.749778:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788869603.749787:0:15713:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e2808343000 00010000:00010000:3.0:1788869603.749796:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbe1a00/0x4c16c38a9b6ce922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6ce929 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788869603.749813:0:15713:0:(import.c:65:import_set_state_nolock()) ffff8e2808343000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788869603.749818:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788869603.749821:0:15713:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788869603.749823:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788869603.749829:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788869603.749844:0:15713:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e2703a8e680 x1875765325122176/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788869609 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788869603.749869:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788869603.749872:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:1.0:1788869603.750029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703412800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788869603.750785:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39:3647:1875765325122176:0@lo:250:kworker.0 10000000:01000000:1.0:1788869603.750872:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788869603.750882:0:15713:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce3aa 00000020:00000080:1.0:1788869603.750890:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e2808345000/8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39 00000020:01000000:1.0:1788869603.750908:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.154@tcp (flags='') 00000020:00000080:1.0:1788869603.750916:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869603.750922:0:15713:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788869603.750926:0:15713:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8e282a933380) has no exports 00000020:00000080:3.0:1788869603.751031:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2808345000/8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39 for MGC192.168.204.154@tcp 10000000:01000000:2.0:1788869603.751873:0:6521:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788869603.753063:0:15713:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.204.154@tcp: client import never connected 00000100:00080000:1.0:1788869603.753070:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788869603.753074:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788869603.753078:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788869603.753081:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788869603.753164:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869603.753173:0:15713:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.154@tcp (uuid 8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39) 00000020:01000000:1.0:1788869603.753186:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788869603.753193:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869603.753197:0:15713:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869603.753207:0:15713:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e27036c7800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869603.753215:0:15713:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8e2840a3cd40) has exports, disconnecting them 00000020:00080000:1.0:1788869603.753221:0:15713:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e27036c7800), last request at 1788869367 00000020:00000080:1.0:1788869603.753227:0:15713:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce77e 00000020:00080000:1.0:1788869603.753242:0:15713:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e27036c7800): rc 0 00000020:00000080:1.0:1788869603.753263:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e27036c7800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788869603.753622:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2808343000 for MGC192.168.204.154@tcp 00000020:00000080:3.0:1788869603.753632:0:36:0:(genops.c:885:class_export_put()) final put ffff8e2808344000/8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39 00000020:00000080:3.0:1788869603.753635:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2808344000/8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39 for MGC192.168.204.154@tcp 00000020:01000000:3.0:1788869603.753643:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.154@tcp (8a1c2e0e-90ba-458a-af0d-5b8f8aa2aa39) 00000020:00000080:3.0:1788869603.754824:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27036c7800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788869603.762853:0:15713:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788869603.762865:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869603.762871:0:15713:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788869603.762881:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869603.762958:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e27036c3000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788869603.763202:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869603.763218:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788869603.763226:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e2702585800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788869603.763230:0:15713:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2702585800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788869603.763237:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788869603.763542:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788869603.763548:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869603.763554:0:15713:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869603.763561:0:15713:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8e282db02800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869603.763568:0:15713:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8e28411e0000) has exports, disconnecting them 00000020:00080000:1.0:1788869603.763574:0:15713:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8e282db02800), last request at 1788869367 00000020:00000080:1.0:1788869603.763578:0:15713:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce793 00000020:00080000:1.0:1788869603.763675:0:15713:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e282db02800): rc 0 00000020:00000080:1.0:1788869603.763681:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e282db02800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788869603.763928:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db02800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788869603.766695:0:15713:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788869603.766706:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788869603.766711:0:15713:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788869603.766720:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869603.766818:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282dac5800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788869603.766912:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788869603.767212:0:7475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788869603.767449:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788869603.767793:0:6508:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e28083af600:6508] 1 exiting: rc = 0 00000100:00100000:2.0:1788869603.767977:0:6507:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e28083ae000:6507] 0 exiting: rc = 1 00000100:00100000:0.0:1788869603.768069:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869603.768430:0:6511:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e282a93c600:6511] 2 exiting: rc = 0 00000100:00100000:1.0:1788869603.768554:0:6510:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e28092d5000:6510] 1 exiting: rc = 0 00000100:00100000:2.0:1788869603.768803:0:10401:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e2703b0bc00:10401] 3 exiting: rc = 0 00000100:00100000:2.0:1788869603.769004:0:6509:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e282a732a00:6509] 0 exiting: rc = 1 00000100:00100000:0.0:1788869603.769088:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769096:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769102:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769107:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769112:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769118:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769123:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769129:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769135:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769141:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769157:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769168:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769199:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769207:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769216:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769221:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769227:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769235:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769241:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769249:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769254:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769259:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769264:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769269:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769274:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769279:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769284:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769288:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769292:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769297:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769301:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769305:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769309:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769313:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769317:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769322:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769328:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769332:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769338:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769343:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769348:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769354:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769359:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769364:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769369:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769382:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769387:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769393:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769399:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769403:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769409:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769415:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769421:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769427:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769432:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769439:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769445:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769451:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769457:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769462:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769468:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769473:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769478:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.769799:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788869603.771334:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869603.771346:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788869603.771353:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e2701f1a800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788869603.771360:0:15713:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2701f1a800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788869603.771367:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788869603.771422:0:15713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e27029d7800 1 00000020:00000080:0.0:1788869603.771430:0:15713:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6ce723 00000020:00000080:0.0:1788869603.771437:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e27029e9800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788869603.771611:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788869603.771616:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869603.771622:0:15713:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788869603.771626:0:15713:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8e2840d819c0) has no exports 00000020:00000080:3.0:1788869603.774034:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029e9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788869603.822452:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869603.822470:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788869603.822794:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e27029d0800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788869603.822803:0:15713:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788869603.822812:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788869603.823253:0:15713:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e27029d1800 00000020:01000000:2.0:1788869603.823281:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788869603.823285:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869603.823290:0:15713:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869603.823294:0:15713:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8e28411e3380) has no exports 00000020:00000080:2.0:1788869603.823318:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869603.823324:0:15713:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788869603.823327:0:15713:0:(genops.c:885:class_export_put()) final put ffff8e282db02000/OSS_uuid 00000020:00000080:2.0:1788869603.823329:0:15713:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db02000/OSS_uuid for OSS 00000020:01000000:2.0:1788869603.823333:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788869603.823608:0:8443:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8e2803e0ac00:8443] 2 exiting: rc = 0 00000100:00100000:2.0:1788869603.823747:0:11338:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8e2703b0c000:11338] 4 exiting: rc = 0 00000100:00100000:2.0:1788869603.823836:0:8743:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8e2701f36800:8743] 3 exiting: rc = 0 00000100:00100000:2.0:1788869603.823909:0:8442:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8e28083aec00:8442] 1 exiting: rc = 0 00000100:00100000:3.0:1788869603.824095:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8e2840d14e00:8440] 0 exiting: rc = 1 00000100:00080000:0.0:1788869603.824215:0:6520:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788869603.824431:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.824443:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.824452:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825026:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825038:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825045:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825051:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825056:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825062:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825078:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825083:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825088:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825094:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825099:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825105:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825110:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825115:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825121:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825126:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825131:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825136:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825142:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825147:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825152:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825156:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825161:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825166:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825171:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825176:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825180:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825185:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825190:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825195:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825201:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825207:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825213:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825219:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825224:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825229:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825240:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825247:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825253:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825258:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825265:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825276:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825281:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825287:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825292:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825298:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825303:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825309:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825315:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825320:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825325:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825330:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825335:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825339:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825345:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825349:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825354:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825359:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825364:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825369:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.825380:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869603.827330:0:11289:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8e283c800400:11289] 2 exiting: rc = 0 00000100:00100000:2.0:1788869603.827518:0:8444:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e2829a74400:8444] 0 exiting: rc = 1 00000100:00100000:2.0:1788869603.827575:0:8445:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e2829a75600:8445] 1 exiting: rc = 0 00000100:00100000:0.0:1788869603.827835:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827856:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827878:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827884:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827890:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827896:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827904:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827910:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827915:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827921:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827927:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827932:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827937:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827944:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827949:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827954:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827959:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827965:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827970:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827976:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827981:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827986:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.827993:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828000:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828005:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828011:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828018:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828023:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828029:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828034:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828039:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828044:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828049:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828054:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828059:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828063:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828068:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828079:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828087:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828093:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828099:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828105:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828110:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828116:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828121:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828126:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828132:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828137:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828143:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828148:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828153:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828157:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828163:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828168:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828174:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828181:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828187:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828192:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828197:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828202:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828206:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828213:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828218:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.828233:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869603.829609:0:8447:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e283b52ca00:8447] 1 exiting: rc = 0 00000100:00100000:3.0:1788869603.829820:0:8446:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e2840d0f200:8446] 0 exiting: rc = 1 00000100:00100000:2.0:1788869603.830384:0:8448:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e283b52da00:8448] 2 exiting: rc = 0 00000100:00100000:1.0:1788869603.830644:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830654:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830660:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830669:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830676:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830692:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830700:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830706:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830713:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830721:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830727:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830734:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830740:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830747:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830754:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830781:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830787:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830795:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830802:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830809:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830817:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830824:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830955:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830966:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830973:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830980:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830987:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.830994:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831001:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831007:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831014:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831022:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831028:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831034:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831040:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831046:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831052:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831059:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831066:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831073:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831079:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831084:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831089:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831095:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831101:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831106:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831124:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831130:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831136:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831142:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831154:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831160:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831166:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831172:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831179:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831185:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831191:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831197:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831203:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831210:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831216:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831223:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831241:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.831258:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869603.839282:0:8450:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e283b52c800:8450] 1 exiting: rc = 0 00000100:00100000:1.0:1788869603.839699:0:8449:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e283b52d800:8449] 0 exiting: rc = 1 00000100:00100000:0.0:1788869603.839820:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839897:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839906:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839914:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839919:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839925:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839933:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839939:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839962:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839968:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839973:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839980:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839987:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.839994:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840001:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840006:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840013:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840019:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840025:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840032:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840038:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840045:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840051:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840058:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840065:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840072:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840078:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840084:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840090:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840095:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840100:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840106:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840112:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840118:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840124:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840130:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840136:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840142:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840148:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840154:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840161:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840166:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840172:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840185:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840190:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840197:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840202:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840208:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840216:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840222:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840228:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840234:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840241:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840247:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840254:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840260:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840265:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840271:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840277:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840284:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840290:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840296:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840302:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.840309:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869603.842452:0:8451:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e2840c55800:8451] 0 exiting: rc = 1 00000100:00100000:2.0:1788869603.846307:0:8452:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e2840c54800:8452] 1 exiting: rc = 0 00000100:00100000:0.0:1788869603.847406:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847419:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847434:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847442:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847450:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847458:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847466:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847474:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847506:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847514:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847521:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847546:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847554:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847561:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847578:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847605:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847613:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847620:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847625:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847633:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847639:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847644:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847651:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847673:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847681:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847687:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847694:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847700:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847706:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847712:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847718:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847725:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847730:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847736:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847742:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847762:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847769:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847776:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847782:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847788:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847794:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847800:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847805:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847810:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847815:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847821:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.847826:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848097:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848105:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848118:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848126:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848133:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848140:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848146:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848154:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848161:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848167:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848174:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848180:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848201:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848209:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848216:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848223:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869603.848240:0:15713:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788869603.876822:0:15713:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788869626.699177:0:16477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788869638.556171:0:17077:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788869638.556179:0:17077:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788869638.556181:0:17077:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788869638.556293:0:17077:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e280a5b7800 00000020:01000004:3.0:1788869638.556312:0:17077:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788869638.556320:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788869638.556340:0:17077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e27025ecd40) 00000020:00000080:3.0:1788869638.556356:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788869638.648555:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788869638.656436:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788869638.661307:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788869638.662773:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788869638.663105:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788869638.663315:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788869638.663496:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788869638.663921:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788869638.664235:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788869638.664463:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788869638.664914:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788869638.665245:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788869638.665450:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788869638.666667:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788869638.683848:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788869638.685516:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788869638.686725:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788869638.687106:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788869638.687360:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788869638.687703:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788869638.687967:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788869638.688428:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788869638.688745:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788869638.689082:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788869638.689309:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788869638.689553:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788869638.690027:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788869638.691246:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.691713:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.692306:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788869638.692546:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.692942:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788869638.693235:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788869638.693451:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788869638.693747:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788869638.694063:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788869638.694237:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.694449:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.694723:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.695027:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.695471:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788869638.695739:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.696195:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.696383:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.696762:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788869638.697192:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788869638.697474:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788869638.698671:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788869638.699184:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788869638.699465:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788869638.699919:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788869638.700224:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788869638.700474:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1788869638.701165:0:17077:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788869638.701378:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788869638.701388:0:17077:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788869638.701400:0:17077:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6cf959 00000020:01000004:1.0:1788869638.701421:0:17077:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788869638.701426:0:17077:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788869638.701432:0:17077:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e280a5b7800 from MGS 00000020:01000004:1.0:1788869638.701435:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788869638.701444:0:17077:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e28411e3380) 00000020:00000080:1.0:1788869638.701463:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788869638.701531:0:17077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e280a5b7800 from MGS, refs=2 00080000:01000000:1.0:1788869638.701537:0:17077:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788869638.701542:0:17077:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6cf967 00000100:00100000:1.0:1788869638.701890:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788869638.702038:0:17077:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788869638.702044:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788869638.702550:0:17077:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788869638.702558:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788869638.703394:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869638.703570:0:17077:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788869638.703736:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788869638.704325:0:17077:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788869638.704332:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788869638.704795:0:17077:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788869638.704803:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788869638.705387:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869638.705391:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869638.705393:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869638.706088:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869638.706091:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869638.706093:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869638.706890:0:17077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788869638.710519:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788869638.715819:0:17077:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788869638.718695:0:17089:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788869638.718740:0:17077:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788869638.718802:0:17077:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788869638.724157:0:17077:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788869638.726026:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869638.726233:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788869638.726242:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788869638.728050:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788869638.728062:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788869638.728360:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788869638.728367:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788869638.729266:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788869638.729288:0:17077:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:3.0:1788869638.729290:0:17077:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788869638.729318:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:3.0:1788869638.729332:0:17077:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (ffff8e27025e99c0) 00000020:00000080:3.0:1788869638.729347:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1788869638.729527:0:17094:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:3.0:1788869638.729739:0:17077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e280a5b3000@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788869638.730116:0:17077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:3.0:1788869638.730125:0:17077:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788869638.735447:0:17095:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788869638.735681:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid 71f22428-daa5-41c2-b06f-55c4031bf12e) 00000020:00000080:2.0:1788869638.735713:0:17077:0:(genops.c:1384:class_connect()) connect: client 71f22428-daa5-41c2-b06f-55c4031bf12e, cookie 0x4c16c38a9b6cf975 00000100:00080000:2.0:1788869638.735727:0:17077:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869638.735742:0:17077:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8e280a5b3000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869638.735784:0:17077:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f0bdf80 x1875765325122944/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869638.735844:0:17077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS 00000020:01000004:2.0:1788869638.735868:0:17077:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788869638.735873:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788869638.735887:0:17077:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e2840d819c0) 00000020:00000080:2.0:1788869638.735899:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788869638.737204:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71f22428-daa5-41c2-b06f-55c4031bf12e:3647:1875765325122944:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788869638.737281:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869638.742569:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325122944 00000100:00100000:3.0:1788869638.742617:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325122944 00000100:00100000:3.0:1788869638.742663:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869638.742673:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1875765325122944:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788869638.742707:0:17091:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 71f22428-daa5-41c2-b06f-55c4031bf12e@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:3.0:1788869638.742741:0:17091:0:(genops.c:1384:class_connect()) connect: client 71f22428-daa5-41c2-b06f-55c4031bf12e, cookie 0x4c16c38a9b6cf983 00000100:00080000:3.0:1788869638.742901:0:17091:0:(import.c:65:import_set_state_nolock()) ffff8e282a390000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869638.743004:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+5:3647:x1875765325122944:12345-0@lo:250:mount.lustre.0 Request processed in 331us (5722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869638.743012:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869638.744914:0:3647:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788869638.744937:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:0.0:1788869638.744947:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788869638.744953:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788869638.744958:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b3000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788869638.745017:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788869638.745029:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788869638.745038:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71f22428-daa5-41c2-b06f-55c4031bf12e:3647:1875765325122944:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788869638.751196:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869638.751656:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788869638.751664:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788869638.755251:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788869638.755267:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788869638.755700:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788869638.755708:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788869638.756388:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869638.756649:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788869638.756655:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788869638.757474:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788869638.757483:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788869638.829183:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869638.829394:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788869638.829401:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788869638.839047:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788869638.839078:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788869638.846552:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869638.847495:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788869638.847504:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788869638.849674:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788869638.849689:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788869638.850326:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869638.850869:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788869638.850880:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788869638.854099:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788869638.854117:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788869638.855333:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869638.856218:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788869638.856227:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788869638.857246:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788869638.857256:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788869638.914696:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869638.917419:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788869638.917428:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788869638.919769:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869638.919784:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788869638.929463:0:17077:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869638.929496:0:17077:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788869638.930439:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788869638.930478:0:17077:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788869638.930486:0:17077:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788869638.930633:0:17077:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788869638.930670:0:17077:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788869638.930674:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788869638.930676:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869638.930677:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869638.930679:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869638.930680:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869638.930681:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869638.930683:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869638.930684:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869638.930686:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869638.930687:0:17077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788869638.930690:0:17077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788869638.930691:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788869638.930692:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869638.930694:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869638.930695:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869638.930696:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869638.930697:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869638.930698:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869638.930699:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869638.930700:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869638.930701:0:17077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788869638.930735:0:17077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788869638.930762:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788869638.930848:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869638.930892:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038dfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869638.931425:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325123072 00000100:00100000:1.0:1788869638.931435:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325123072 00000100:00100000:1.0:1788869638.931496:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869638.931505:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+5:17077:x1875765325123072:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788869638.931555:0:17093:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788869638.931558:0:17093:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788869638.931565:0:17093:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788869638.934529:0:17114:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788869638.935703:0:17093:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788869638.942633:0:17115:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788869638.942646:0:17115:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788869638.942651:0:17115:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788869638.942653:0:17115:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788869638.942922:0:17115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788869638.949451:0:17093:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788869638.949466:0:17093:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788869638.955420:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+5:17077:x1875765325123072:12345-0@lo:253:mount.lustre.0 Request processed in 23904us (24560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869638.955435:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869638.955614:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123072:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788869638.955631:0:17077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788869638.955634:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869638.955636:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869638.955637:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869638.955638:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869638.955654:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869638.955656:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869638.955657:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869638.955658:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869638.955660:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869638.955662:0:17077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788869638.955686:0:17077:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e280a5b7800 from lustre-MDT0000 10000000:01000000:0.0:1788869638.955721:0:17077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788869638.955724:0:17077:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788869638.955740:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e27025e99c0 10000000:01000000:0.0:1788869638.955745:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869638.955754:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e27025e99c0 from 1 10000000:01000000:0.0:1788869638.955757:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788869638.955795:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.955806:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.955815:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869638.955847:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869638.955886:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869638.955931:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869638.956112:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325123200 00000100:00100000:3.0:1788869638.956120:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325123200 00000100:00100000:3.0:1788869638.956180:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869638.956191:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+5:17077:x1875765325123200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869638.956213:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869638.956228:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8000/0x4c16c38a9b6cf991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cf98a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.956252:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8000/0x4c16c38a9b6cf991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cf98a expref: 6 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.956262:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed8000/0x4c16c38a9b6cf991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cf98a expref: 6 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.956271:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8000, rc 0) 00000100:00100000:3.0:1788869638.956313:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+6:17077:x1875765325123200:12345-0@lo:101:mount.lustre.0 Request processed in 125us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869638.956319:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869638.956984:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869638.957000:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.957009:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869638.957093:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869638.957130:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869638.957158:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869638.957506:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325123328 00000100:00100000:3.0:1788869638.957513:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325123328 00000100:00100000:3.0:1788869638.957546:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869638.957554:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+6:17077:x1875765325123328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869638.957687:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+6:17077:x1875765325123328:12345-0@lo:501:mount.lustre.0 Request processed in 133us (556us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869638.957693:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869638.957956:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123328:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788869638.958004:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788869638.958023:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.958032:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869638.958056:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e280a5b7800 10000000:01000000:0.0:1788869638.958060:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788869638.958065:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e280a5b7800 10000000:01000000:0.0:1788869638.958068:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788869638.958071:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e280a5b7800 from 1 10000000:01000000:0.0:1788869638.958074:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788869638.958100:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.958107:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.958116:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869638.958131:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869638.958162:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869638.958192:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869638.958317:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325123456 00000100:00100000:2.0:1788869638.958322:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325123456 00000100:00100000:2.0:1788869638.958356:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869638.958363:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+6:17077:x1875765325123456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869638.958373:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869638.958387:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6cf99f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cf998 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.958482:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6cf99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cf998 expref: 7 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.958492:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6cf99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cf998 expref: 7 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.958501:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb000, rc 0) 00000100:00100000:2.0:1788869638.958542:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+7:17077:x1875765325123456:12345-0@lo:101:mount.lustre.0 Request processed in 179us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.958548:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869638.959391:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123456:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869638.959850:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.959862:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869638.959881:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788869638.959900:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.960240:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869638.960249:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788869638.960255:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869638.960262:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e280a5b7800 10000000:01000000:0.0:1788869638.960265:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788869638.960269:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788869638.960272:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788869638.960302:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.960310:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.960319:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869638.960340:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869638.960830:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869638.960926:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869638.961036:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325123584 00000100:00100000:1.0:1788869638.961046:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325123584 00000100:00100000:1.0:1788869638.961164:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869638.961174:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+7:17077:x1875765325123584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869638.961190:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869638.961206:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6cf9ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cf9a6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.961230:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6cf9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cf9a6 expref: 8 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.961241:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6cf9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cf9a6 expref: 8 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.961249:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f200, rc 0) 00000100:00100000:1.0:1788869638.961321:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+8:17077:x1875765325123584:12345-0@lo:101:mount.lustre.0 Request processed in 149us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869638.961328:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869638.961415:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869638.961430:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.961439:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869638.961516:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869638.961543:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869638.963204:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869638.963293:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325123712 00000100:00100000:2.0:1788869638.963302:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325123712 00000100:00100000:2.0:1788869638.963341:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869638.963349:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+8:17077:x1875765325123712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869638.963557:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+9:17077:x1875765325123712:12345-0@lo:501:mount.lustre.0 Request processed in 208us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.963577:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869638.963876:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869638.963960:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869638.964006:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869638.964035:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869638.964151:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325123840 00000100:00100000:2.0:1788869638.964156:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325123840 00000100:00100000:2.0:1788869638.964179:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869638.964185:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+9:17077:x1875765325123840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869638.965188:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+9:17077:x1875765325123840:12345-0@lo:503:mount.lustre.0 Request processed in 996us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.965199:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869638.965439:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325123840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869638.966014:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17116:1875765325123968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869638.966076:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869638.966117:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869638.966282:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325123968 00000100:00100000:2.0:1788869638.966289:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325123968 00000100:00100000:2.0:1788869638.966318:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869638.966326:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+9:17116:x1875765325123968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869638.967126:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+9:17116:x1875765325123968:12345-0@lo:502:llog_process_th.0 Request processed in 794us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.967137:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869638.967569:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17116:1875765325123968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869638.967626:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869638.967638:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869638.967641:0:17116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788869638.967646:0:17116:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788869638.967649:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869638.967665:0:17116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e2840a3b380) 00000020:00000080:0.0:1788869638.967682:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788869638.967687:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788869638.967793:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788869638.967801:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6cf9bb 00000020:00000080:0.0:1788869638.968157:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788869638.968162:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869638.968165:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869638.968173:0:17116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788869638.968177:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869638.968181:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869638.968182:0:17116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788869638.968185:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869638.968193:0:17116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e2840a3cd40) 00000020:00000080:0.0:1788869638.968202:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788869638.968206:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788869638.968208:0:17116:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788869638.968211:0:17116:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788869638.968216:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788869638.968264:0:17116:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e280a5b7800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788869638.968276:0:17116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e2840a38000) 00000020:00000080:0.0:1788869638.968283:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788869638.968341:0:17116:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788869638.968347:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6cf9d0 00000020:00000080:0.0:1788869638.968460:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788869638.968466:0:17116:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788869638.968471:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4c16c38a9b6cf9d7 00080000:01000000:0.0:1788869638.968476:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788869638.968479:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6cf9de 00010000:00010000:2.0:1788869639.102562:0:17116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788869639.105274:0:17116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1788869639.106221:0:17116:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788869639.110806:0:17116:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e2840a399c0) 00000020:00000080:0.0:1788869639.110843:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788869639.110987:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788869639.110996:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6cf9ec 00000020:00000080:1.0:1788869639.113195:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788869639.123354:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4c16c38a9b6cf9f3 00000020:00000080:2.0:1788869639.124686:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788869639.124699:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869639.124707:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869639.124709:0:17116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788869639.124712:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788869639.124716:0:17116:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788869639.124718:0:17116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869639.124719:0:17116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869639.124721:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788869639.124736:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869639.124746:0:17116:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788869639.124750:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869639.124756:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869639.124757:0:17116:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788869639.124762:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788869639.124835:0:17116:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788869639.125215:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869639.125220:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869639.125222:0:17116:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788869639.125226:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869639.125230:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869639.125232:0:17116:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788869639.125235:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788869639.125241:0:17116:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:00000080:2.0:1788869639.125273:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869639.125292:0:17116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e2840d83380) 00000020:00000080:2.0:1788869639.125313:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788869639.125319:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788869639.125411:0:17116:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788869639.125417:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788869639.125424:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6cfa01 00010000:00080000:2.0:1788869639.125463:0:17116:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2704140800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788869639.132171:0:17116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788869639.136195:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788869639.136212:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788869639.136267:0:17116:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788869639.136294:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6cfa08 00000100:00080000:3.0:1788869639.136308:0:17116:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869639.136323:0:17116:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2704140800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869639.136375:0:17116:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8e680 x1875765325124096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869639.136416:0:17116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788869639.136496:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869639.136500:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869639.136503:0:17116:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788869639.136506:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788869639.136521:0:17116:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788869639.136523:0:17116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869639.136525:0:17116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869639.136527:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788869639.136531:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869639.136533:0:17116:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788869639.136536:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869639.136541:0:17116:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788869639.136545:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869639.136547:0:17116:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788869639.136552:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869639.136556:0:17116:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:3.0:1788869639.136580:0:17116:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788869639.136583:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869639.136624:0:17116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e27025eb380) 00000020:00000080:3.0:1788869639.136641:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788869639.136647:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869639.136733:0:17116:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788869639.136740:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788869639.136750:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6cfa16 00010000:00080000:3.0:1788869639.136802:0:17116:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282a39b800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788869639.137046:0:17116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788869639.138486:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325124224:0@lo:400:kworker.0 00000100:00100000:3.0:1788869639.139186:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.139275:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325124096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869639.139331:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869639.139799:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325124224 00000100:00100000:2.0:1788869639.139809:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325124224 00000100:00100000:2.0:1788869639.139879:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869639.139889:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+9:3651:x1875765325124224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869639.139978:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+9:3651:x1875765325124224:12345-0@lo:400:kworker.0 Request processed in 90us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.139987:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869639.140048:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325124224:0@lo:400:kworker.0 00000100:00100000:3.0:1788869639.140666:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325124096 00000100:00100000:3.0:1788869639.140676:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325124096 00000100:00100000:3.0:1788869639.140703:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869639.140709:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325124096:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788869639.141046:0:17103:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788869639.147421:0:17116:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788869639.147919:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788869639.165181:0:17116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869639.165918:0:17116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788869639.176198:0:17116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788869639.176693:0:17122:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788869639.176699:0:17122:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788869639.184275:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869639.184294:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869639.184355:0:17116:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788869639.184379:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6cfa1d 00000100:00080000:2.0:1788869639.184390:0:17116:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869639.184403:0:17116:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e282a39b800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869639.184446:0:17116:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f0bd500 x1875765325124352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869639.184544:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325124352:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788869639.184634:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325124352 offset 0 length 520: 4 00000100:00080000:2.0:1788869639.184704:0:17116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788869639.184766:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869639.184772:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869639.184773:0:17116:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788869639.184776:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788869639.184778:0:17116:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788869639.184780:0:17116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869639.184781:0:17116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869639.184783:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788869639.184785:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869639.184787:0:17116:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788869639.184789:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788869639.184793:0:17116:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788869639.185098:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869639.185101:0:17116:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788869639.185105:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788869639.185109:0:17116:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:2.0:1788869639.185136:0:17116:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788869639.185139:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869639.185167:0:17116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e2840d80000) 00000020:00000080:2.0:1788869639.185182:0:17116:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788869639.185189:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788869639.185255:0:17116:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788869639.185262:0:17116:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788869639.185268:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6cfa2b 00010000:00080000:2.0:1788869639.185300:0:17116:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282db3e000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869639.185569:0:17116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788869639.185701:0:17116:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788869639.185721:0:17116:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788869639.190065:0:17116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788869639.190518:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325124096:12345-0@lo:38:llog_process_th.0 Request processed in 49791us (51170us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869639.190539:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788869639.191026:0:17116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788869639.191174:0:17116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:0.0:1788869639.191377:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869639.191390:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788869639.191442:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325124096:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788869639.192083:0:17124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788869639.192090:0:17124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788869639.193726:0:17116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869639.193741:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788869639.193784:0:17116:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788869639.194024:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6cfa32 00000100:00080000:0.0:1788869639.194037:0:17116:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869639.194053:0:17116:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e282db3e000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869639.194100:0:17116:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a0380 x1875765325124480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869639.194173:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325124480:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788869639.194265:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325124480 offset 0 length 520: 4 00000100:00080000:0.0:1788869639.194325:0:17116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788869639.194406:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869639.194412:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.194414:0:17116:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788869639.194418:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869639.194423:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.194424:0:17116:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869639.194426:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869639.194428:0:17116:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869639.194431:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869639.194433:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.194435:0:17116:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788869639.194437:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869639.194439:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.194440:0:17116:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788869639.194445:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788869639.194478:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17116:1875765325124608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869639.194546:0:17116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.194747:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869639.195038:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325124608 00000100:00100000:3.0:1788869639.195048:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325124608 00000100:00100000:3.0:1788869639.195120:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869639.195131:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+9:17116:x1875765325124608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869639.195301:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+9:17116:x1875765325124608:12345-0@lo:502:llog_process_th.0 Request processed in 172us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869639.195310:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869639.195339:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17116:1875765325124608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869639.195375:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869639.195381:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869639.195383:0:17116:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788869639.195386:0:17116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788869639.195512:0:17077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788869639.195567:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788869639.195615:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869639.195627:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869639.195636:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e280a5b7800 from 1 10000000:01000000:3.0:1788869639.195640:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869639.195673:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869639.195682:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869639.195692:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869639.195717:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325124736:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869639.195749:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869639.195886:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869639.195998:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325124736 00000100:00100000:1.0:1788869639.196005:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325124736 00000100:00100000:1.0:1788869639.196040:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869639.196050:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+9:17077:x1875765325124736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869639.196063:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869639.196079:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfa39 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.196108:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa39 expref: 10 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.196121:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa39 expref: 10 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.196144:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e800, rc 0) 00000100:00100000:1.0:1788869639.196187:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+10:17077:x1875765325124736:12345-0@lo:101:mount.lustre.0 Request processed in 139us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869639.196195:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869639.196253:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325124736:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869639.196269:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869639.196279:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869639.197522:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325124864:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788869639.197645:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869639.197759:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869639.198022:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325124864 00000100:00100000:0.0:1788869639.198032:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325124864 00000100:00100000:0.0:1788869639.198079:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869639.198088:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+10:17077:x1875765325124864:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788869639.198107:0:17092:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788869639.198115:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788869639.198218:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+10:17077:x1875765325124864:12345-0@lo:256:mount.lustre.0 Request processed in 130us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869639.198225:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869639.200276:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325124864:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788869639.202048:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869639.202131:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.202149:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869639.202348:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e280a5b7800 from 1 10000000:01000000:0.0:1788869639.202354:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869639.202486:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869639.202496:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869639.202756:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869639.202791:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325124992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869639.203139:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.203232:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869639.203291:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325124992 00000100:00100000:2.0:1788869639.203301:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325124992 00000100:00100000:2.0:1788869639.203375:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869639.203384:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+10:17077:x1875765325124992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869639.203466:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869639.203498:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfa47 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.203524:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa47 expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.203536:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa47 expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.203546:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb600, rc 0) 00000100:00100000:2.0:1788869639.203705:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17077:x1875765325124992:12345-0@lo:101:mount.lustre.0 Request processed in 322us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.203713:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869639.204111:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325124992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869639.204131:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869639.204141:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869639.204230:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869639.204269:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.204343:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869639.204477:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325125120 00000100:00100000:1.0:1788869639.204484:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325125120 00000100:00100000:1.0:1788869639.204567:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869639.204577:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17077:x1875765325125120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869639.204806:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17077:x1875765325125120:12345-0@lo:501:mount.lustre.0 Request processed in 221us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869639.204826:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869639.204913:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869639.204975:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869639.205012:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.205713:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869639.205845:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325125248 00000100:00100000:3.0:1788869639.205854:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325125248 00000100:00100000:3.0:1788869639.205894:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869639.205902:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17077:x1875765325125248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869639.206042:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17077:x1875765325125248:12345-0@lo:503:mount.lustre.0 Request processed in 139us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869639.206049:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788869639.206265:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869639.207019:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17126:1875765325125376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869639.207089:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869639.207128:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2811aa93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869639.207182:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325125376 00000100:00100000:3.0:1788869639.207188:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325125376 00000100:00100000:3.0:1788869639.207228:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869639.207237:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17126:x1875765325125376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869639.208229:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17126:x1875765325125376:12345-0@lo:502:llog_process_th.0 Request processed in 990us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869639.208247:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869639.208359:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17126:1875765325125376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869639.208393:0:17126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869639.208416:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.208419:0:17126:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788869639.208427:0:17126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e280a5b7800 00000020:00000080:0.0:1788869639.208430:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869639.208440:0:17126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869639.208442:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.208444:0:17126:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788869639.208447:0:17126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869639.208449:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.208451:0:17126:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788869639.208454:0:17126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e280a5b7800 00000020:00000080:0.0:1788869639.208456:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869639.208524:0:17126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869639.208527:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.208528:0:17126:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788869639.208531:0:17126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869639.208539:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.208540:0:17126:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869639.208545:0:17126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e280a5b7800 00000020:00000080:0.0:1788869639.208547:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869639.208565:0:17126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869639.208568:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.208569:0:17126:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869639.208572:0:17126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869639.208574:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869639.208576:0:17126:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788869639.208579:0:17126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e280a5b7800 00000020:00000080:0.0:1788869639.208582:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788869639.208643:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17126:1875765325125504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869639.208684:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.208714:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869639.210949:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325125504 00000100:00100000:2.0:1788869639.210964:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325125504 00000100:00100000:2.0:1788869639.211052:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869639.211065:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17126:x1875765325125504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869639.211253:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17126:x1875765325125504:12345-0@lo:502:llog_process_th.0 Request processed in 190us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.211261:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869639.211335:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17126:1875765325125504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869639.211374:0:17126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869639.211383:0:17126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869639.211385:0:17126:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788869639.211389:0:17126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788869639.211755:0:17077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788869639.211780:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869639.211821:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869639.211835:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869639.211899:0:17077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788869639.211902:0:17077:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e280a5b7800 10000000:01000000:0.0:1788869639.211906:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e280a5b7800 10000000:01000000:0.0:1788869639.211910:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869639.211917:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e280a5b7800 from 1 10000000:01000000:0.0:1788869639.211930:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869639.211968:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869639.211987:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869639.211997:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869639.212018:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869639.212065:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.212097:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869639.212948:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325125632 00000100:00100000:2.0:1788869639.212962:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325125632 00000100:00100000:2.0:1788869639.213009:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869639.213018:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17077:x1875765325125632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869639.213043:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869639.213064:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6cfa5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfa55 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.213093:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6cfa5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa55 expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.213105:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6cfa5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa55 expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.213114:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda800, rc 0) 00000100:00100000:2.0:1788869639.213174:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17077:x1875765325125632:12345-0@lo:101:mount.lustre.0 Request processed in 157us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.213181:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869639.213945:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869639.213963:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869639.213974:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869639.214058:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869639.214110:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.214150:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869639.214320:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325125760 00000100:00100000:2.0:1788869639.214328:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325125760 00000100:00100000:2.0:1788869639.214377:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869639.214385:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17077:x1875765325125760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869639.214638:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17077:x1875765325125760:12345-0@lo:501:mount.lustre.0 Request processed in 253us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.214646:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869639.215018:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869639.215056:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869639.215097:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.215118:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038df180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869639.215175:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325125888 00000100:00100000:2.0:1788869639.215180:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325125888 00000100:00100000:2.0:1788869639.215209:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869639.215216:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17077:x1875765325125888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869639.215289:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17077:x1875765325125888:12345-0@lo:503:mount.lustre.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.215306:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869639.216002:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325125888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869639.225291:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17128:1875765325126016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869639.226021:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869639.231114:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27038dfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869639.231257:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325126016 00000100:00100000:2.0:1788869639.231270:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325126016 00000100:00100000:2.0:1788869639.231339:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869639.231350:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17128:x1875765325126016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869639.235245:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17128:x1875765325126016:12345-0@lo:502:llog_process_th.0 Request processed in 3876us (9830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.235267:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869639.235380:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17128:1875765325126016:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788869639.235459:0:17128:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788869639.235480:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e2840d84d40) 00000020:00000080:2.0:1788869639.235504:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788869639.235643:0:17128:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e280a5b7800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788869639.235648:0:17128:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e280a5b7800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788869639.235652:0:17128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e280a5b7800 4 00010000:00080000:2.0:1788869639.235687:0:17128:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e280a6c0000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869639.239273:0:17128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788869639.239507:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788869639.239554:0:17128:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869639.239572:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4c16c38a9b6cfa6a 00000100:00080000:2.0:1788869639.239615:0:17128:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869639.239631:0:17128:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e280a6c0000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869639.239685:0:17128:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f0bca80 x1875765325126144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869639.239714:0:17128:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788869639.240042:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325126144:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869639.240136:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869639.240278:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325126144 00000100:00100000:2.0:1788869639.240292:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325126144 00000100:00100000:2.0:1788869639.240324:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869639.240331:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765325126144:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869639.240446:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765325126144:12345-0@lo:38:llog_process_th.0 Request processed in 57us (253us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788869639.240455:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869639.240504:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869639.240512:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a6c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869639.240516:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788869639.240520:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325126144:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869639.243314:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17128:1875765325126272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869639.243436:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869639.243496:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869639.243526:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325126272 00000100:00100000:2.0:1788869639.243534:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325126272 00000100:00100000:2.0:1788869639.243605:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869639.243614:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17128:x1875765325126272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869639.243744:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17128:x1875765325126272:12345-0@lo:502:llog_process_th.0 Request processed in 128us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.243753:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869639.245076:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17128:1875765325126272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869639.245194:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17128:1875765325126400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869639.245303:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869639.245369:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869639.245405:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325126400 00000100:00100000:2.0:1788869639.245424:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325126400 00000100:00100000:2.0:1788869639.245482:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869639.245492:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17128:x1875765325126400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869639.245646:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17128:x1875765325126400:12345-0@lo:502:llog_process_th.0 Request processed in 154us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.245654:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869639.245702:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71f22428-daa5-41c2-b06f-55c4031bf12e:17128:1875765325126400:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788869639.245720:0:17128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788869639.256940:0:17077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788869639.256987:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869639.257019:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.257037:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788869639.258925:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788869639.258934:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788869639.258936:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869639.258937:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869639.258939:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869639.258951:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869639.258953:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869639.258954:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788869639.258956:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869639.258957:0:17077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869639.258962:0:17077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788869639.258965:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869639.258966:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788869639.258967:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869639.258968:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869639.258969:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869639.258970:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869639.258971:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869639.258972:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788869639.258973:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869639.258974:0:17077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869639.259016:0:17077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788869639.259045:0:17077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325126528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869639.259144:0:17077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869639.259202:0:17077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2811aa9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869639.259538:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325126528 00000100:00100000:2.0:1788869639.259549:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325126528 00000100:00100000:2.0:1788869639.260967:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869639.260984:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17077:x1875765325126528:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788869639.261020:0:17092:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788869639.261036:0:17092:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788869639.265670:0:17092:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869639.265692:0:17092:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788869639.268692:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17077:x1875765325126528:12345-0@lo:253:mount.lustre.0 Request processed in 7704us (9536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.268708:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869639.269012:0:17077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17077:1875765325126528:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788869639.269027:0:17077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788869639.269030:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869639.269032:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869639.269033:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869639.269035:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869639.269036:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869639.269037:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869639.269038:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869639.269040:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869639.269042:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869639.269043:0:17077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788869639.269060:0:17077:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788869639.271500:0:17114:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788869639.271511:0:17114:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788869639.271537:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869639.271556:0:17114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa39 expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869639.271563:0:17114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869639.271641:0:17114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfa39 expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869639.271658:0:17114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa39 expref: 11 pid: 17091 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869639.271673:0:17114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325126656:0@lo:104: 00000100:00100000:3.0:1788869639.271743:0:17114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869639.271789:0:17114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2811858b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869639.272337:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325126656 00000100:00100000:1.0:1788869639.272347:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325126656 00000100:00100000:1.0:1788869639.272918:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869639.272931:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:17114:x1875765325126656:12345-0@lo:104: 00010000:00010000:1.0:1788869639.272947:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.273019:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869639.273025:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:17114:x1875765325126656:12345-0@lo:104: Request processed in 99us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869639.273033:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788869639.273059:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869639.273066:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.273086:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869639.273090:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.273100:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869639.273108:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869639.273115:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869639.273154:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.273161:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788869639.273496:0:17114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325126656:0@lo:104: 00010000:00010000:3.0:1788869639.273524:0:17114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.274365:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.274378:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6cfa39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfa40 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869639.274969:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869639.274974:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869639.274976:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869639.275309:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869639.275328:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325126784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869639.276923:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869639.277052:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325126784 00000100:00100000:2.0:1788869639.277063:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325126784 00010000:00010000:2.0:1788869639.277106:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa39 expref: 12 pid: 17091 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869639.277142:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869639.277165:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+12:3649:x1875765325126784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869639.277477:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869639.277485:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa39 expref: 12 pid: 17091 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277499:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa39 expref: 12 pid: 17091 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277517:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cfa40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa39 expref: 12 pid: 17091 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277543:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277554:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869639.277573:0:17083:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006062804s 00010000:00010000:2.0:1788869639.277578:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277608:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277617:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277624:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277631:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869639.277644:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277654:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277675:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.277689:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869639.277766:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+11:3649:x1875765325126784:12345-0@lo:103:ldlm_bl.0 Request processed in 603us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.277774:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869639.279331:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325126784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869639.279381:0:17114:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.279992:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869639.280002:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfa71 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788869639.307509:0:17077:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788869639.307969:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788869639.309473:0:17138:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788869639.309480:0:17138:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788869639.316304:0:17139:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788869639.316333:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788869639.317992:0:17139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869639.325616:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788869639.325707:0:17139:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:2.0:1788869639.327631:0:17140:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8e282f0bf800 x1875765325126912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869639.327647:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00000040:01000000:1.0:1788869639.332504:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788869639.332575:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788869639.333549:0:17077:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788869639.333567:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788869639.333654:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869639.337078:0:17077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788869639.338615:0:17077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788869639.338691:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788869639.345931:0:17077:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788869639.352627:0:17077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788869639.356204:0:17077:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788869639.356253:0:17077:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9f681867988 00100000:10000000:1.0:1788869639.356263:0:17077:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788869639.365583:0:17077:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788869639.365620:0:17077:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788869639.365644:0:17077:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788869639.365665:0:17077:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788869639.366843:0:17077:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869639.367097:0:17077:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869639.750041:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869640.263206:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788869640.390889:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 10000000:01000000:1.0:1788869640.773683:0:17095:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788869640.773697:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e280a5b7800 from 7 10000000:01000000:1.0:1788869640.773705:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788869640.773775:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869640.773802:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869640.773814:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869640.773844:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325127040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869640.773925:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869640.773994:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a735840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869640.774114:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325127040 00000100:00100000:3.0:1788869640.774124:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325127040 00000100:00100000:3.0:1788869640.774195:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869640.774210:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+11:17095:x1875765325127040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869640.774237:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869640.774251:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfa78 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869640.774278:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa78 expref: 12 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869640.774289:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa78 expref: 12 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869640.774299:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8c00, rc 0) 00000100:00100000:3.0:1788869640.774344:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17095:x1875765325127040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.774351:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869640.774733:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325127040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869640.774751:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869640.774761:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869640.774842:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325127168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788869640.774879:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869640.774914:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869640.775044:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325127168 00000100:00100000:3.0:1788869640.775049:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325127168 00000100:00100000:3.0:1788869640.775097:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788869640.775106:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17095:x1875765325127168:12345-0@lo:256:ll_cfg_requeue.0 00010000:00010000:1.0:1788869640.775120:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788869640.775128:0:17092:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869640.775190:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869640.775194:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788869640.775290:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17095:x1875765325127168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.775298:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869640.775301:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325127168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788869640.775346:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869640.775353:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869640.775361:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869641.289702:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869641.417257:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788869641.801995:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869642.446278:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788869642.823700:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869643.461746:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:2.0:1788869643.850377:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869644.079920:0:17383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788869644.486687:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00000100:00080000:0.0:1788869644.624790:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1788869644.625010:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325127296:0@lo:400:kworker.0 00000100:00100000:2.0:1788869644.625319:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869644.626334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788869644.626342:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869644.626351:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 573 00000100:00080000:0.0:1788869644.626360:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788869644.626376:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2704140800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869644.626427:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a2300 x1875765325127424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869644.626461:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869644.627263:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869644.627408:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325127424:0@lo:38:kworker.0 00000100:00080000:0.0:1788869644.628141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869644.628147:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869644.628151:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788869644.628155:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788869644.628160:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e280a6c0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869644.628187:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e280a6c0000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869644.628292:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a0700 x1875765325127552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869644.628430:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325127296 00000100:00100000:3.0:1788869644.628447:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325127296 00000100:00100000:3.0:1788869644.628519:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869644.628546:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+12:3649:x1875765325127296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869644.628721:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+12:3649:x1875765325127296:12345-0@lo:400:kworker.0 Request processed in 166us (3390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869644.628729:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869644.628816:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325127296:0@lo:400:kworker.0 00000100:00100000:2.0:1788869644.629096:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869644.629180:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325127552:0@lo:38:kworker.0 00000100:00100000:2.0:1788869644.629239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869644.629298:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325127552 00000100:00100000:2.0:1788869644.629306:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325127552 00000100:00100000:2.0:1788869644.629340:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869644.629348:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325127552:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788869644.629381:0:17100:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:2.0:1788869644.629446:0:17100:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4c16c38a9b6cfa86 00000004:00100000:2.0:1788869644.629466:0:17100:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869644.629723:0:17100:0:(import.c:65:import_set_state_nolock()) ffff8e282db3b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869644.629797:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765325127552:12345-0@lo:38:kworker.0 Request processed in 448us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869644.629814:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788869644.629867:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e27028a0700 x1875765325127552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869644.629885:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788869644.629896:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788869644.629903:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869644.629906:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a6c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869644.629913:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325127552:0@lo:38:kworker.0 00000100:00100000:3.0:1788869644.630112:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325127424 00000100:00100000:3.0:1788869644.630124:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325127424 00000100:00100000:3.0:1788869644.630165:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869644.630174:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325127424:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788869644.630197:0:17104:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869644.666277:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325127424:12345-0@lo:38:kworker.0 Request processed in 36079us (37160us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869644.666337:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788869644.670504:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869644.670521:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788869644.670527:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325127424:0@lo:38:kworker.0 00010000:00010000:1.0:1788869644.870914:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869645.335332:0:17435:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869645.335515:0:17435:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788869645.514063:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788869645.893936:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869646.476230:0:17485:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869646.476454:0:17485:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788869646.534683:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788869646.921753:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869647.557868:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788869647.946318:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869648.581690:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:2.0:1788869648.966280:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869649.609810:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00000100:00100000:0.0:1788869649.736847:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869639/real 1788869639] req@ffff8e27028a0380 x1875765325124480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869649 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869649.736885:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e27028a0380 x1875765325124480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869649 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869649.736906:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869639/real 1788869639] req@ffff8e282f0bd500 x1875765325124352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869649 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869649.736921:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e282f0bd500 x1875765325124352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869649 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869649.736941:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869649.736951:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788869649.736955:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325124480:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788869649.736962:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282a39b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869649.736991:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788869649.736995:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325124352:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788869649.738377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869649.738385:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788869649.738389:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869649.738398:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 578 00000100:00080000:3.0:1788869649.738405:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788869649.738419:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2704140800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869649.738447:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8fb80 x1875765325127808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869649.738464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869649.738475:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788869649.738477:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e282a39b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869649.738481:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 573 00000100:00080000:3.0:1788869649.738484:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869649.738489:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e282a39b800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869649.738502:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8c380 x1875765325127936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869649.738510:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869649.738513:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788869649.738515:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869649.738517:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 573 00000100:00080000:3.0:1788869649.738519:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869649.738523:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e282db3e000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869649.738533:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8d500 x1875765325128064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869649.738903:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325127680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869649.739168:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869649.739235:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869649.739242:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325128192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869649.739279:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869649.739672:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325127808:0@lo:38:kworker.0 00000100:00100000:1.0:1788869649.739712:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869649.739735:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325127936:0@lo:8:kworker.0 00000400:00000100:1.0:1788869649.739758:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325127936 offset 0 length 520: 4 00000100:00100000:1.0:1788869649.740530:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325128064:0@lo:8:kworker.0 00000400:00000100:1.0:1788869649.740567:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325128064 offset 0 length 520: 4 00000100:00100000:3.0:1788869649.741224:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325127680 00000100:00100000:3.0:1788869649.741235:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325127680 00000100:00100000:3.0:1788869649.741305:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869649.741316:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:3650:x1875765325127680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869649.741392:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+12:3650:x1875765325127680:12345-0@lo:400:kworker.0 Request processed in 79us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869649.741399:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869649.741636:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325127680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869649.741983:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325128192 00000100:00100000:3.0:1788869649.741991:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325128192 00000100:00100000:3.0:1788869649.742030:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869649.742038:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325128192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869649.742116:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325128192:12345-0@lo:400:kworker.0 Request processed in 78us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869649.742123:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788869649.742466:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e2703a8ed80 x1875765325128192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869649.742481:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325128192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869649.742905:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325127808 00000100:00100000:1.0:1788869649.742910:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325127808 00000100:00100000:1.0:1788869649.742947:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869649.742953:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325127808:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788869649.742976:0:17103:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788869649.783206:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325127808:12345-0@lo:38:kworker.0 Request processed in 40241us (43483us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788869649.783226:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788869649.784831:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869649.784842:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788869649.784847:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325127808:0@lo:38:kworker.0 00010000:00010000:1.0:1788869650.000138:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869650.630665:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788869651.022003:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869651.527491:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869651.654500:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788869652.040622:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869652.677877:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788869653.062297:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869653.702455:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788869654.085785:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788869654.157974:0:17830:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788869654.157979:0:17830:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788869654.157981:0:17830:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788869654.162792:0:17830:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e282dac7800 00000020:01000004:0.0:1788869654.162818:0:17830:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788869654.162837:0:17830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788869654.162884:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8e283d3e3380) 00000020:00000080:0.0:1788869654.162905:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788869654.263355:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788869654.263972:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788869654.275968:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788869654.279939:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788869654.280509:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.281057:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.281439:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.281888:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.282174:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.286025:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.286573:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.287002:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.287341:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.287619:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.287973:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.288477:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.289208:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.289426:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.289780:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.290214:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.290438:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.291232:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.291762:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.292210:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.292995:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.293986:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.295360:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.296267:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.297345:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.298860:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.299396:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788869654.299883:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.300187:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788869654.303938:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788869654.310954:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788869654.313474:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788869654.314953:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788869654.315839:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788869654.317708:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788869654.318541:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788869654.318921:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788869654.319164:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788869654.319368:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788869654.320082:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788869654.320333:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788869654.320968:0:17830:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:01000000:3.0:1788869654.322207:0:17830:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788869654.322461:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788869654.322474:0:17830:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788869654.322488:0:17830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6cfa94 00000020:01000004:3.0:1788869654.322502:0:17830:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788869654.322542:0:17830:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788869654.322547:0:17830:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788869654.322554:0:17830:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788869654.322638:0:17830:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788869654.322643:0:17830:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788869654.344639:0:17830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788869654.344707:0:17830:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788869654.344712:0:17830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788869654.344714:0:17830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788869654.344715:0:17830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869654.344717:0:17830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869654.344718:0:17830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869654.344719:0:17830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869654.344721:0:17830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869654.344724:0:17830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869654.344725:0:17830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788869654.344730:0:17830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788869654.344733:0:17830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788869654.344735:0:17830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788869654.344736:0:17830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869654.344737:0:17830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869654.344739:0:17830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869654.344740:0:17830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869654.344741:0:17830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869654.344742:0:17830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869654.344743:0:17830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788869654.344780:0:17830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788869654.344805:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128320:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788869654.344896:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.344984:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.345258:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325128320 00000100:00100000:3.0:1788869654.345272:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325128320 00000100:00100000:3.0:1788869654.345369:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869654.345383:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17830:x1875765325128320:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869654.345461:0:17093:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788869654.345466:0:17093:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788869654.345477:0:17093:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788869654.353443:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17830:x1875765325128320:12345-0@lo:253:mount.lustre.0 Request processed in 8051us (8533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.353462:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869654.353668:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788869654.353686:0:17830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788869654.353690:0:17830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869654.353692:0:17830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788869654.353693:0:17830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869654.353695:0:17830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869654.353696:0:17830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869654.353697:0:17830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869654.353698:0:17830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869654.353700:0:17830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869654.353702:0:17830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788869654.353729:0:17830:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e282dac7800 from lustre-MDT0001 10000000:01000000:0.0:1788869654.353771:0:17830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788869654.353775:0:17830:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788869654.353784:0:17830:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e27025e99c0 local copy 00010000:00010000:0.0:1788869654.353798:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869654.353960:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869654.354010:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.354441:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325128448 00000100:00100000:2.0:1788869654.354449:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325128448 00000100:00100000:2.0:1788869654.354557:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869654.354815:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17830:x1875765325128448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869654.354921:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17830:x1875765325128448:12345-0@lo:501:mount.lustre.0 Request processed in 111us (914us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869654.354928:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869654.355400:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869654.355432:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128448:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788869654.355453:0:17830:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788869654.355481:0:17830:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788869654.355491:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.355502:0:17830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869654.355734:0:17830:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e282dac7800 10000000:01000000:0.0:1788869654.355740:0:17830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788869654.355747:0:17830:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e27025e99c0 10000000:01000000:0.0:1788869654.355749:0:17830:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788869654.355753:0:17830:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e27025e99c0 from 1 10000000:01000000:0.0:1788869654.355756:0:17830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788869654.355788:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.355797:0:17830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.355807:0:17830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869654.355826:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869654.355869:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.358319:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869654.359367:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325128576 00000100:00100000:2.0:1788869654.359382:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325128576 00000100:00100000:2.0:1788869654.359449:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869654.359460:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+12:17830:x1875765325128576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869654.359479:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869654.359500:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6cfaa2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfa9b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.359568:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6cfaa2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa9b expref: 13 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.359581:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6cfaa2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa9b expref: 13 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.359819:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda200, rc 0) 00000100:00100000:2.0:1788869654.359901:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+13:17830:x1875765325128576:12345-0@lo:101:mount.lustre.0 Request processed in 444us (4031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.359908:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869654.360015:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869654.360036:0:17830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfaa2 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.360046:0:17830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfaa2 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869654.360067:0:17830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788869654.360095:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfaa2 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.360114:0:17830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfaa2 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869654.360125:0:17830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e282dac7800 10000000:01000000:0.0:1788869654.360129:0:17830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788869654.360133:0:17830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e282dac7800 from 1 10000000:01000000:0.0:1788869654.360135:0:17830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788869654.360160:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.360167:0:17830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.360175:0:17830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869654.360206:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869654.360245:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.360273:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.360437:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325128704 00000100:00100000:3.0:1788869654.360442:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325128704 00000100:00100000:3.0:1788869654.360481:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869654.360490:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+13:17830:x1875765325128704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869654.360501:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869654.360511:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8400/0x4c16c38a9b6cfab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfaa9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.360541:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8400/0x4c16c38a9b6cfab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfaa9 expref: 14 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.360550:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed8400/0x4c16c38a9b6cfab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfaa9 expref: 14 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.360557:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8400, rc 0) 00000100:00100000:3.0:1788869654.360617:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+14:17830:x1875765325128704:12345-0@lo:101:mount.lustre.0 Request processed in 128us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.360630:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869654.361264:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869654.361278:0:17830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.361287:0:17830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869654.361299:0:17830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788869654.361314:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.361332:0:17830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869654.361339:0:17830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788869654.361343:0:17830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869654.361350:0:17830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e282dac7800 10000000:01000000:0.0:1788869654.361352:0:17830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788869654.361356:0:17830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788869654.361358:0:17830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788869654.361381:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.361389:0:17830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.361396:0:17830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869654.361409:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869654.361445:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.361480:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.361804:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325128832 00000100:00100000:3.0:1788869654.361811:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325128832 00000100:00100000:3.0:1788869654.361851:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869654.361858:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+14:17830:x1875765325128832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869654.361868:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869654.361878:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfabe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfab7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.361895:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfab7 expref: 15 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.361904:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfab7 expref: 15 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.361910:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9400, rc 0) 00000100:00100000:3.0:1788869654.361950:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325128832:12345-0@lo:101:mount.lustre.0 Request processed in 93us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.361956:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788869654.362028:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869654.362040:0:17830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.362048:0:17830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869654.363893:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788869654.364576:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869654.370332:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788869654.370389:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788869654.370404:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788869654.370416:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788869654.370432:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788869654.370446:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788869654.370464:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788869654.370477:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788869654.370489:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788869654.370501:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788869654.370515:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788869654.370547:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788869654.370799:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788869654.370823:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788869654.370852:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788869654.370865:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788869654.370877:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788869654.370888:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788869654.370900:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788869654.370913:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788869654.370927:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788869654.370940:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788869654.370954:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788869654.370988:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788869654.370994:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788869654.371208:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869654.371298:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869654.371397:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869654.371444:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325128960 00000100:00100000:0.0:1788869654.371453:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325128960 00000100:00100000:0.0:1788869654.371575:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869654.371616:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325128960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869654.371772:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325128960:12345-0@lo:501:mount.lustre.0 Request processed in 187us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869654.371780:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869654.371877:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325128960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869654.371909:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325129088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869654.371945:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869654.372423:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.372478:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325129088 00000100:00100000:3.0:1788869654.372484:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325129088 00000100:00100000:3.0:1788869654.372513:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869654.372533:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325129088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869654.373483:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325129088:12345-0@lo:503:mount.lustre.0 Request processed in 957us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.373493:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788869654.373808:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325129088:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788869654.374364:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869654.374478:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325129216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869654.374815:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.374926:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.374972:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325129216 00000100:00100000:3.0:1788869654.374980:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325129216 00000100:00100000:3.0:1788869654.375081:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869654.375091:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325129216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869654.376248:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325129216:12345-0@lo:502:mount.lustre.0 Request processed in 1154us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.376257:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869654.376358:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325129216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869654.376679:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788869654.376714:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788869654.376727:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788869654.376739:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788869654.376752:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788869654.376765:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788869654.376778:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788869654.376791:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788869654.376805:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788869654.376819:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788869654.376832:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788869654.376843:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788869654.376855:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788869654.376996:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788869654.377018:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788869654.377034:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788869654.377051:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788869654.377065:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788869654.377077:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788869654.377091:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788869654.377117:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788869654.377131:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788869654.377141:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788869654.377153:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788869654.377165:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788869654.377176:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788869654.377187:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788869654.377199:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788869654.377213:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788869654.377227:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788869654.377241:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788869654.377256:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788869654.377271:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788869654.377307:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788869654.377323:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788869654.377336:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788869654.377348:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788869654.377358:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788869654.377368:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788869654.377381:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788869654.377393:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788869654.377405:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788869654.377417:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788869654.377429:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788869654.377478:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325129344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869654.377570:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.382920:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869654.383393:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325129344 00000100:00100000:2.0:1788869654.383406:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325129344 00000100:00100000:2.0:1788869654.383514:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869654.383535:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325129344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869654.383763:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325129344:12345-0@lo:502:mount.lustre.0 Request processed in 230us (6192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.383771:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788869654.383814:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325129344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869654.383915:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788869654.383931:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788869654.384901:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869654.384915:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869654.384918:0:17834:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788869654.384924:0:17834:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788869654.384927:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869654.384941:0:17834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8e28411e19c0) 00000020:00000080:1.0:1788869654.384962:0:17834:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788869654.384970:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788869654.385076:0:17834:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788869654.385084:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6cfacc 00000020:00000080:1.0:1788869654.385303:0:17834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788869654.385308:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869654.385312:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869654.385314:0:17834:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788869654.385317:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869654.385321:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869654.385322:0:17834:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788869654.385326:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869654.385334:0:17834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8e28411e0000) 00000020:00000080:1.0:1788869654.385345:0:17834:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788869654.385349:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788869654.385352:0:17834:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788869654.385355:0:17834:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788869654.385362:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788869654.385408:0:17834:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e282dac7800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788869654.385421:0:17834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8e28411e4d40) 00000020:00000080:1.0:1788869654.385429:0:17834:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788869654.385504:0:17834:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788869654.385511:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6cfae1 00000020:00000080:1.0:1788869654.385862:0:17834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788869654.385871:0:17834:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788869654.385877:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4c16c38a9b6cfae8 00080000:01000000:1.0:1788869654.385883:0:17834:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788869654.385887:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6cfaef 00010000:00010000:0.0:1788869654.455789:0:17834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788869654.456274:0:17834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1788869654.456767:0:17834:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788869654.457898:0:17834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788869654.457912:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869654.457919:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869654.457922:0:17834:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788869654.457927:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869654.457932:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869654.457934:0:17834:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788869654.457937:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788869654.457949:0:17834:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:00000080:1.0:1788869654.457977:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869654.457994:0:17834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8e28179f8000) 00000020:00000080:1.0:1788869654.458019:0:17834:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788869654.458025:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788869654.458108:0:17834:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788869654.458115:0:17834:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788869654.458124:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6cfafd 00010000:00080000:1.0:1788869654.458158:0:17834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2817983800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788869654.460439:0:17834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788869654.465016:0:17834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788869654.465033:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788869654.465089:0:17834:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788869654.465132:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6cfb04 00000100:00080000:0.0:1788869654.465147:0:17834:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869654.465164:0:17834:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e2817983800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869654.465221:0:17834:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a0380 x1875765325129472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869654.465257:0:17834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788869654.465293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788869654.465298:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788869654.465301:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869654.465305:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 583 00000100:00080000:0.0:1788869654.465310:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788869654.465316:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2704140800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869654.465331:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a1500 x1875765325129600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869654.465341:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869654.465351:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869654.465354:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869654.465357:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869654.465411:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325129728:0@lo:400:kworker.0 00000100:00100000:0.0:1788869654.465487:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788869654.465867:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869654.465872:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.465874:0:17834:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788869654.465877:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788869654.465880:0:17834:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788869654.465881:0:17834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869654.465883:0:17834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869654.465885:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788869654.465887:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.465889:0:17834:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788869654.465891:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869654.465896:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.465897:0:17834:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788869654.465900:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788869654.465940:0:17834:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788869654.465953:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869654.465955:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.465957:0:17834:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788869654.465959:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788869654.465961:0:17834:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788869654.465962:0:17834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869654.465964:0:17834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869654.465965:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788869654.465968:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.465969:0:17834:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788869654.465972:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869654.465981:0:17834:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788869654.465984:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.465986:0:17834:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788869654.465989:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788869654.465993:0:17834:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:0.0:1788869654.466016:0:17834:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788869654.466019:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869654.466032:0:17834:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8e283d3e0000) 00000020:00000080:0.0:1788869654.466046:0:17834:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788869654.466051:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788869654.466129:0:17834:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788869654.466138:0:17834:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788869654.466145:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6cfb12 00010000:00080000:0.0:1788869654.466180:0:17834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282d8cb000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1788869654.466404:0:17834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788869654.466673:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325129472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788869654.466747:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869654.466791:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325129600:0@lo:38:kworker.0 00000100:00100000:1.0:1788869654.466811:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869654.466859:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325129472 00000100:00100000:1.0:1788869654.466868:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325129472 00000100:00100000:1.0:1788869654.466892:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325129600 00000100:00100000:1.0:1788869654.466894:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325129600 00000100:00100000:1.0:1788869654.466906:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869654.466917:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325129472:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788869654.466951:0:17104:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:1.0:1788869654.467006:0:17104:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6cfb19 00000004:00100000:1.0:1788869654.467022:0:17104:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788869654.467030:0:17104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:0.0:1788869654.468844:0:17834:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788869654.469062:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325129728 00000100:00100000:3.0:1788869654.469076:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325129728 00000040:01000000:0.0:1788869654.469171:0:17834:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788869654.470010:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869654.470026:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325129728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869654.470158:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325129728:12345-0@lo:400:kworker.0 Request processed in 138us (4671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.470168:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788869654.472744:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e27028a1180 x1875765325129728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869654.472767:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325129728:0@lo:400:kworker.0 00000040:00080000:0.0:1788869654.474202:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869654.474719:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788869654.474844:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1788869654.475903:0:17839:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788869654.475909:0:17839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788869654.478212:0:17834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788869654.478227:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788869654.478270:0:17834:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788869654.478294:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6cfb20 00000100:00080000:0.0:1788869654.478306:0:17834:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869654.478317:0:17834:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e282d8cb000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869654.478356:0:17834:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a1180 x1875765325129856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869654.478397:0:17834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788869654.478425:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869654.478429:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869654.478432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869654.478434:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788869654.478478:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869654.478481:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.478483:0:17834:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788869654.478486:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788869654.478488:0:17834:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788869654.478490:0:17834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869654.478491:0:17834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869654.478492:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788869654.478494:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.478496:0:17834:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788869654.478498:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1788869654.479012:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325129856:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788869654.479081:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325129856 offset 0 length 520: 4 00000020:01000004:0.0:1788869654.481697:0:17834:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788869654.481711:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.481713:0:17834:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788869654.481725:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788869654.481731:0:17834:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:0.0:1788869654.481761:0:17834:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788869654.481764:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869654.481783:0:17834:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8e283d3e4d40) 00000020:00000080:0.0:1788869654.481808:0:17834:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788869654.481814:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788869654.481902:0:17834:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788869654.481910:0:17834:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788869654.481929:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6cfb2e 00010000:00080000:0.0:1788869654.481977:0:17834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282d8c9000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1788869654.482207:0:17834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788869654.482280:0:17834:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788869654.482301:0:17834:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788869654.484490:0:17104:0:(import.c:65:import_set_state_nolock()) ffff8e282d8ca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869654.485270:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765325129472:12345-0@lo:38:llog_process_th.0 Request processed in 18349us (18519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869654.485281:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869654.485312:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869654.485318:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325129600:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788869654.485357:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325129600:12345-0@lo:38:kworker.0 Request processed in 38us (18544us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788869654.485362:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869654.485405:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869654.485415:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788869654.485423:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788869654.485429:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788869654.485431:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2817983800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788869654.485443:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325129472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869654.485456:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869654.485459:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869654.485462:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788869654.485465:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325129600:0@lo:38:kworker.0 00000100:00100000:0.0:1788869654.485552:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325129984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869654.487436:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.488203:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325129984 00000100:00100000:2.0:1788869654.488215:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325129984 00000100:00100000:2.0:1788869654.488258:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869654.488267:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1875765325129984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869654.488306:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869654.488398:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1875765325129984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.488404:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:1.0:1788869654.488818:0:17834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869654.489093:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325129984:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788869654.489336:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788869654.489477:0:17834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788869654.490202:0:17841:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788869654.490208:0:17841:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788869654.491086:0:17834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788869654.491112:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788869654.491152:0:17834:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788869654.491178:0:17834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6cfb35 00000100:00080000:0.0:1788869654.491189:0:17834:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869654.491199:0:17834:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e282d8c9000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869654.491236:0:17834:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a2680 x1875765325130112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869654.491268:0:17834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788869654.491328:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869654.491332:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.491335:0:17834:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788869654.491338:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869654.491342:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.491343:0:17834:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869654.491346:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869654.491348:0:17834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869654.491351:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869654.491353:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.491355:0:17834:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788869654.491357:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869654.491360:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.491361:0:17834:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788869654.491364:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788869654.491389:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869654.491392:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869654.491394:0:17834:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788869654.491397:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1788869654.491454:0:17830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788869654.491483:0:17830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788869654.491497:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.491545:0:17830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869654.491555:0:17830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e282dac7800 from 1 10000000:01000000:0.0:1788869654.491559:0:17830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:2.0:1788869654.491929:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325130112:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788869654.492014:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325130112 offset 0 length 520: 4 00000100:00080000:3.0:1788869654.492137:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869654.492144:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869654.492147:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869654.492150:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788869654.492357:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.492367:0:17830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.492380:0:17830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869654.492399:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869654.492437:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.492489:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.493055:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325130240 00000100:00100000:3.0:1788869654.493064:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325130240 00000100:00100000:3.0:1788869654.493175:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788869654.493186:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+15:17830:x1875765325130240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869654.493202:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869654.493228:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfb3c expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.493259:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb3c expref: 16 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.493270:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb3c expref: 16 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.493279:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9c00, rc 0) 00000100:00100000:3.0:1788869654.493416:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+16:17830:x1875765325130240:12345-0@lo:101:mount.lustre.0 Request processed in 231us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.493424:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869654.493791:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869654.493810:0:17830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.493821:0:17830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869654.494362:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130368:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788869654.494405:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.494472:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869654.494750:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325130368 00000100:00100000:1.0:1788869654.494758:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325130368 00000100:00100000:1.0:1788869654.494823:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869654.494831:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+16:17830:x1875765325130368:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788869654.494848:0:17093:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788869654.494865:0:17093:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788869654.494868:0:17093:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788869654.494946:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+16:17830:x1875765325130368:12345-0@lo:256:mount.lustre.0 Request processed in 116us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.494953:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869654.495022:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130368:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788869654.495637:0:17830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788869654.495667:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.495678:0:17830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869654.495686:0:17830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282dac7800 from 1 10000000:01000000:0.0:1788869654.495689:0:17830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869654.495715:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.495722:0:17830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.495732:0:17830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869654.495748:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869654.495785:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.496377:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869654.496448:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325130496 00000100:00100000:2.0:1788869654.496458:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325130496 00000100:00100000:2.0:1788869654.496512:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869654.496532:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+16:17830:x1875765325130496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869654.496545:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869654.496559:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfb4a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.496584:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb4a expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.496801:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb4a expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.496812:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edaa00, rc 0) 00000100:00100000:2.0:1788869654.496873:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325130496:12345-0@lo:101:mount.lustre.0 Request processed in 342us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.496880:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869654.496966:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869654.496984:0:17830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869654.496994:0:17830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869654.497205:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869654.497251:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869654.497288:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.497320:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869654.497439:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325130624 00000100:00100000:2.0:1788869654.497445:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325130624 00000100:00100000:2.0:1788869654.497468:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869654.497474:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325130624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869654.497581:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325130624:12345-0@lo:501:mount.lustre.0 Request processed in 107us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.497688:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869654.497832:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869654.497862:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869654.497906:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.497934:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869654.498018:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325130752 00000100:00100000:1.0:1788869654.498023:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325130752 00000100:00100000:1.0:1788869654.498047:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869654.498054:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325130752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869654.498160:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325130752:12345-0@lo:503:mount.lustre.0 Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.498166:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869654.498254:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788869654.498715:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869654.498788:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869654.498834:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869654.498852:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869654.499082:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325130880 00000100:00100000:1.0:1788869654.499089:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325130880 00000100:00100000:1.0:1788869654.499124:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869654.499132:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325130880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869654.499230:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325130880:12345-0@lo:502:mount.lustre.0 Request processed in 98us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.499238:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869654.499290:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325130880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788869654.499511:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788869654.499560:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788869654.499575:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788869654.499735:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788869654.499752:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788869654.499763:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788869654.499774:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788869654.499786:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788869654.499815:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788869654.499827:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788869654.499837:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788869654.499867:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869654.499912:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869654.499933:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869654.499950:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325131008 00000100:00100000:1.0:1788869654.499955:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325131008 00000100:00100000:1.0:1788869654.499978:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869654.499984:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325131008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869654.500054:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325131008:12345-0@lo:502:mount.lustre.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.500061:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869654.500228:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788869654.500268:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788869654.500275:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788869654.501122:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869654.501137:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869654.501147:0:17843:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788869654.501156:0:17843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e282dac7800 00000020:00000080:2.0:1788869654.501159:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869654.501167:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869654.501170:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869654.501171:0:17843:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788869654.501173:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869654.501176:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869654.501177:0:17843:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788869654.501179:0:17843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e282dac7800 00000020:00000080:2.0:1788869654.501181:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869654.501268:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869654.501271:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869654.501272:0:17843:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788869654.501274:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869654.501276:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869654.501278:0:17843:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869654.501281:0:17843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e282dac7800 00000020:00000080:2.0:1788869654.501282:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869654.501298:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869654.501300:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869654.501302:0:17843:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869654.501304:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869654.501306:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869654.501307:0:17843:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788869654.501309:0:17843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e282dac7800 00000020:00000080:2.0:1788869654.501311:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869654.501329:0:17843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869654.501331:0:17843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869654.501333:0:17843:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788869654.501335:0:17843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788869654.502203:0:17830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788869654.502241:0:17830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869654.502264:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.502292:0:17830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869654.502351:0:17830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788869654.502354:0:17830:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e282dac7800 10000000:01000000:1.0:1788869654.502357:0:17830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e282dac7800 10000000:01000000:1.0:1788869654.502361:0:17830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869654.502366:0:17830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e282dac7800 from 1 10000000:01000000:1.0:1788869654.502369:0:17830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869654.502411:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.502419:0:17830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.502428:0:17830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869654.502452:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869654.502514:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869654.502568:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869654.503186:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325131136 00000100:00100000:1.0:1788869654.503197:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325131136 00000100:00100000:1.0:1788869654.503247:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788869654.503257:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17830:x1875765325131136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869654.503274:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869654.503289:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6cfb5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfb58 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.503327:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6cfb5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb58 expref: 18 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.503338:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6cfb5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb58 expref: 18 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.503346:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f400, rc 0) 00000100:00100000:1.0:1788869654.503397:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131136:12345-0@lo:101:mount.lustre.0 Request processed in 142us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.503404:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788869654.503461:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869654.503477:0:17830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.503485:0:17830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869654.508964:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788869654.509357:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869654.509836:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788869654.509865:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788869654.509880:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788869654.509894:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788869654.509909:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788869654.509923:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788869654.509937:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788869654.509951:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788869654.509966:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788869654.509980:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788869654.509993:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788869654.510005:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788869654.510018:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788869654.510049:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788869654.510064:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788869654.510078:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788869654.510092:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788869654.511238:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788869654.511251:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788869654.511262:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788869654.511272:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788869654.511283:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788869654.511294:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788869654.511306:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788869654.511316:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788869654.511327:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788869654.511338:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788869654.511348:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788869654.511371:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788869654.511376:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788869654.511485:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869654.511579:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.512025:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809ba10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869654.512052:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325131264 00000100:00100000:2.0:1788869654.512059:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325131264 00000100:00100000:2.0:1788869654.512109:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869654.512118:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869654.512237:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131264:12345-0@lo:501:mount.lustre.0 Request processed in 120us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.512245:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869654.512301:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869654.512329:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869654.512362:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.512377:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809ba10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.514416:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325131392 00000100:00100000:3.0:1788869654.514431:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325131392 00000100:00100000:3.0:1788869654.514496:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788869654.514507:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869654.514707:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131392:12345-0@lo:503:mount.lustre.0 Request processed in 203us (2343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.514716:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869654.514985:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869654.519721:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869654.519893:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869654.520003:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.520067:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809ba10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.521830:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325131520 00000100:00100000:3.0:1788869654.521847:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325131520 00000100:00100000:3.0:1788869654.521916:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869654.521925:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869654.523260:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869654.523502:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788869654.523549:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788869654.523563:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788869654.523578:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788869654.523697:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788869654.523715:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788869654.523731:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788869654.523742:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788869654.523756:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788869654.523783:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788869654.523798:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788869654.523811:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788869654.523825:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788869654.523839:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788869654.523872:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788869654.523887:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788869654.523900:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788869654.523915:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788869654.523928:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788869654.523940:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788869654.523956:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788869654.523970:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788869654.523984:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788869654.523996:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788869654.524008:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788869654.524021:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788869654.524035:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788869654.524051:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788869654.524064:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788869654.524076:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000100:00100000:3.0:1788869654.524221:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131520:12345-0@lo:502:mount.lustre.0 Request processed in 2295us (4217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.524233:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000040:00080000:2.0:1788869654.525766:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788869654.525809:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788869654.525825:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788869654.525839:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788869654.525853:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788869654.525869:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788869654.525884:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788869654.525899:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788869654.525913:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788869654.525926:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788869654.525941:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788869654.525955:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788869654.525982:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788869654.525996:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788869654.526010:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788869654.526024:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788869654.526059:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788869654.526078:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788869654.530212:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869654.530325:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.530388:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809ba10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869654.530432:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325131648 00000100:00100000:2.0:1788869654.530440:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325131648 00000100:00100000:2.0:1788869654.530498:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869654.530509:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869654.539984:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131648:12345-0@lo:502:mount.lustre.0 Request processed in 9465us (9649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.540001:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869654.540570:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869654.541018:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788869654.541048:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788869654.541106:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869654.541173:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.541223:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809ba10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.542289:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325131776 00000100:00100000:3.0:1788869654.542310:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325131776 00000100:00100000:3.0:1788869654.542365:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869654.542376:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869654.542551:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325131776:12345-0@lo:502:mount.lustre.0 Request processed in 177us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.542560:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869654.543412:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325131776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869654.543582:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788869654.543693:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788869654.548416:0:17848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788869654.548437:0:17848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8e283b578000) 00000020:00000080:2.0:1788869654.548471:0:17848:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788869654.548892:0:17848:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e282dac7800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788869654.548898:0:17848:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e282dac7800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788869654.548901:0:17848:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e282dac7800 3 00010000:00080000:2.0:1788869654.548934:0:17848:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2701f18000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788869654.556946:0:17848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788869654.557872:0:17848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788869654.557926:0:17848:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788869654.557941:0:17848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4c16c38a9b6cfb6d 00000100:00080000:3.0:1788869654.557965:0:17848:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869654.557979:0:17848:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e2701f18000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869654.558022:0:17848:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8e680 x1875765325131904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869654.558050:0:17848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788869654.558082:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869654.558088:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869654.558091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869654.558101:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869654.565751:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325131904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869654.565849:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.566276:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325131904 00000100:00100000:2.0:1788869654.566285:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325131904 00000100:00100000:2.0:1788869654.566326:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869654.566334:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325131904:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788869654.566367:0:17100:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:2.0:1788869654.566406:0:17100:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4c16c38a9b6cfb74 00000004:00100000:2.0:1788869654.566427:0:17100:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869654.566469:0:17100:0:(import.c:65:import_set_state_nolock()) ffff8e2701f1a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869654.566719:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765325131904:12345-0@lo:38:llog_process_th.0 Request processed in 383us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.566727:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788869654.566775:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e2703a8e680 x1875765325131904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869654.566787:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869654.566797:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788869654.566804:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788869654.566810:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869654.566812:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2701f18000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869654.566818:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325131904:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788869654.568765:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788869654.571920:0:17830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788869654.571983:0:17830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869654.572012:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.572026:0:17830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788869654.573216:0:17830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788869654.573225:0:17830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869654.573227:0:17830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869654.573228:0:17830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869654.573229:0:17830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869654.573232:0:17830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869654.573233:0:17830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869654.573235:0:17830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869654.573237:0:17830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869654.573242:0:17830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788869654.573245:0:17830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869654.573247:0:17830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869654.573248:0:17830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869654.573249:0:17830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869654.573251:0:17830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869654.573252:0:17830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869654.573253:0:17830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869654.573254:0:17830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869654.573255:0:17830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869654.573286:0:17830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788869654.573311:0:17830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325132032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788869654.573406:0:17830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869654.573461:0:17830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869654.573570:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325132032 00000100:00100000:2.0:1788869654.573578:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325132032 00000100:00100000:2.0:1788869654.573801:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869654.573812:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325132032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788869654.573849:0:17092:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788869654.573866:0:17092:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788869654.577254:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788869654.577484:0:17092:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788869654.577505:0:17092:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788869654.578054:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17830:x1875765325132032:12345-0@lo:253:mount.lustre.0 Request processed in 4236us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.578069:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788869654.578265:0:17830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:17830:1875765325132032:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788869654.578279:0:17830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788869654.578283:0:17830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869654.578285:0:17830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788869654.578287:0:17830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869654.578288:0:17830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869654.578289:0:17830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869654.578290:0:17830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869654.578292:0:17830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869654.578294:0:17830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869654.578296:0:17830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788869654.578333:0:17830:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788869654.579340:0:17114:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788869654.579349:0:17114:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788869654.579376:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.579394:0:17114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa78 expref: 17 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.579402:0:17114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb3c expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.579409:0:17114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.579455:0:17114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfb3c expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.579471:0:17114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb3c expref: 17 pid: 17092 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869654.579485:0:17114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325132160:0@lo:104: 00000100:00100000:2.0:1788869654.579563:0:17114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869654.579650:0:17114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfa78 expref: 17 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869654.579676:0:17114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa78 expref: 17 pid: 17093 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869654.579687:0:17114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325132288:0@lo:104: 00000100:00100000:2.0:1788869654.579712:0:17114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.579735:0:17114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809ba10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869654.581263:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325132160 00000100:00100000:1.0:1788869654.581278:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325132160 00000100:00100000:1.0:1788869654.581323:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325132288 00000100:00100000:1.0:1788869654.581327:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325132288 00000100:00100000:1.0:1788869654.581344:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869654.581354:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+4:17114:x1875765325132160:12345-0@lo:104: 00010000:00010000:1.0:1788869654.581374:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581500:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869654.581536:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+4:17114:x1875765325132160:12345-0@lo:104: Request processed in 182us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.581544:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869654.581564:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869654.581571:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:17114:x1875765325132288:12345-0@lo:104: 00010000:00010000:1.0:1788869654.581579:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581636:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869654.581642:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:17114:x1875765325132288:12345-0@lo:104: Request processed in 73us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.581649:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788869654.581669:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869654.581678:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581686:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869654.581690:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581699:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869654.581707:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869654.581713:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869654.581755:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581773:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869654.581799:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581807:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5000/0x4c16c38a9b6cfb3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb43 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581820:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869654.581823:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581829:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ee00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869654.581832:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581840:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869654.581846:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869654.581851:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869654.581865:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581870:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869654.581876:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581882:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7ee00/0x4c16c38a9b6cfa78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfa7f expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869654.581903:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869654.581905:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869654.581907:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869654.581914:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869654.581940:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325132416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869654.581991:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869654.582027:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869654.582032:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325132544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869654.582051:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869654.582715:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325132416 00000100:00100000:3.0:1788869654.582723:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325132416 00010000:00010000:3.0:1788869654.582748:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb3c expref: 18 pid: 17092 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869654.582771:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325132544 00000100:00100000:3.0:1788869654.582780:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325132544 00010000:00010000:3.0:1788869654.582791:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa78 expref: 19 pid: 17093 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869654.582803:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869654.582809:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+19:3650:x1875765325132416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869654.582820:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869654.582825:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb3c expref: 19 pid: 17092 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.582835:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb3c expref: 19 pid: 17092 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.582852:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869654.582889:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+19:3650:x1875765325132416:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.582896:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869654.582908:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869654.582913:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:3650:x1875765325132544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869654.582920:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869654.582923:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa78 expref: 18 pid: 17093 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.582932:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa78 expref: 18 pid: 17093 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.582945:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.582955:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869654.582974:0:17083:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006062804s 00010000:00010000:3.0:1788869654.582979:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.582986:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.582991:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.582998:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.583003:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869654.583007:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.583015:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.583023:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.583033:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869654.583053:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:3650:x1875765325132544:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.583059:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788869654.583093:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfb43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb3c expref: 17 pid: 17092 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869654.583112:0:17114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325132160:0@lo:104: 00010000:00010000:3.0:1788869654.583122:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfa7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa78 expref: 16 pid: 17093 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869654.583129:0:17114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325132288:0@lo:104: 00010000:00010000:3.0:1788869654.583147:0:17114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.583155:0:17114:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.583161:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869654.583167:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6cfb7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869654.583745:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325132544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869654.583755:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325132416:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1788869654.593792:0:17830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788869654.599151:0:17854:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788869654.599161:0:17854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788869654.604087:0:17855:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788869654.604802:0:17830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788869654.605889:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788869654.615977:0:17830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788869654.616028:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869654.616806:0:17857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1875765325132672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869654.616878:0:17857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869654.616914:0:17857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736900 going to sleep for 11 seconds 00000040:00080000:1.0:1788869654.621956:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788869654.622048:0:17855:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00000080:2.0:1788869654.622767:0:17830:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788869654.622784:0:17830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788869654.622930:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869654.624880:0:17830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788869654.625240:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325132672 00000100:00100000:3.0:1788869654.625251:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325132672 00000100:00100000:3.0:1788869654.625301:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869654.625313:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1875765325132672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869654.625451:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1875765325132672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 141us (8573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.625459:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869654.625537:0:17857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1875765325132672:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788869654.625577:0:17857:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788869654.625656:0:17857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1875765325132800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869654.625703:0:17857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869654.625729:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325132800 00000100:00100000:3.0:1788869654.625733:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325132800 00000100:00100000:3.0:1788869654.625750:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869654.625757:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1875765325132800:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869654.625851:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1875765325132800:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.625857:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869654.625874:0:17857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869654.625886:0:17857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1875765325132800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869654.625948:0:17857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17857:1875765325132928:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788869654.625978:0:17857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869654.625998:0:17857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736600 going to sleep for 11 seconds 00000040:00080000:2.0:1788869654.626868:0:17830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788869654.626923:0:17830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788869654.627052:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788869654.631802:0:17830:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1788869654.632389:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325132928 00000100:00100000:1.0:1788869654.632405:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325132928 00000100:00100000:1.0:1788869654.632478:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869654.632490:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17857:x1875765325132928:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788869654.632640:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17857:x1875765325132928:12345-0@lo:900:lod0001_rec0000.0 Request processed in 152us (6659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.632647:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788869654.633298:0:17857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e2703a8ca80 x1875765325132928/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869670 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869654.633319:0:17857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17857:1875765325132928:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788869654.633408:0:17857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1875765325133056:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869654.633465:0:17857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869654.633509:0:17857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869654.635310:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325133056 00000100:00100000:1.0:1788869654.635326:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325133056 00000100:00100000:1.0:1788869654.635385:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869654.635404:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1875765325133056:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788869654.635618:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1875765325133056:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 218us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869654.635628:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869654.637814:0:17857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1875765325133056:0@lo:1000:lod0001_rec0000.0 00000001:00000004:2.0:1788869654.637991:0:17830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:1.0:1788869654.638256:0:17857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869654.642205:0:17857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788869654.642285:0:17857:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788869654.642291:0:17857:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788869654.659071:0:17830:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788869654.659126:0:17830:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb9f6815c7988 00100000:10000000:2.0:1788869654.659135:0:17830:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788869654.660985:0:17830:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788869654.661031:0:17830:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788869654.661051:0:17830:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788869654.661072:0:17830:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788869654.662053:0:17830:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869654.662301:0:17830:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788869654.730661:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788869655.110312:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869655.639147:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869655.750263:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788869656.135249:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869656.262105:0:17095:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869656.262113:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e282dac7800 from 8 10000000:01000000:2.0:1788869656.262119:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869656.262170:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869656.262183:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869656.262196:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869656.262225:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325133184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869656.262297:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869656.262355:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869656.262501:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325133184 00000100:00100000:3.0:1788869656.262520:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325133184 00000100:00100000:3.0:1788869656.262623:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869656.262634:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+16:17095:x1875765325133184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869656.262651:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869656.262667:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfb82 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869656.262693:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb82 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869656.262706:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb82 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869656.262718:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8c00, rc 0) 00000100:00100000:3.0:1788869656.262776:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325133184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869656.262784:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788869656.262899:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325133184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869656.262916:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869656.262925:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869656.262981:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325133312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788869656.263018:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869656.263048:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869656.263067:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325133312 00000100:00100000:3.0:1788869656.263072:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325133312 00000100:00100000:3.0:1788869656.263125:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788869656.263133:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325133312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788869656.263147:0:17092:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869656.263166:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869656.263169:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788869656.263266:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325133312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869656.263273:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869656.263516:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325133312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869656.263564:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869656.263572:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869656.263581:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869656.263619:0:17095:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869656.263622:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e280a5b7800 from 8 10000000:01000000:2.0:1788869656.263624:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869656.263645:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869656.263660:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869656.263668:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869656.263684:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325133440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869656.263716:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869656.263734:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869656.263792:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325133440 00000100:00100000:0.0:1788869656.263796:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325133440 00000100:00100000:0.0:1788869656.263829:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788869656.263836:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325133440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869656.263844:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869656.263856:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfb90 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869656.263873:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb90 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869656.263882:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb90 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869656.263890:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4200, rc 0) 00000100:00100000:0.0:1788869656.263917:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17095:x1875765325133440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869656.263931:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788869656.264002:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325133440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869656.264013:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869656.264021:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869656.264055:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325133568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869656.264094:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869656.264112:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869656.264332:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325133568 00000100:00100000:0.0:1788869656.264336:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325133568 00000100:00100000:0.0:1788869656.264363:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869656.264369:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17095:x1875765325133568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788869656.264379:0:17091:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788869656.264391:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788869656.264394:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788869656.264450:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17095:x1875765325133568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 81us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869656.264457:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788869656.264620:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325133568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869656.264658:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869656.264664:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869656.264671:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869656.647726:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869656.773815:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788869657.158061:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869657.799736:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788869658.188814:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869658.821724:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788869659.209832:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869659.454184:0:18100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788869659.846703:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 0 seconds 00000100:00080000:3.0:1788869659.973843:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869659.973859:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788869659.975179:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869659.975203:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e2704140800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869659.975236:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8e300 x1875765325133824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869659.975259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869659.975263:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869659.975266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869659.975269:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869659.975302:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869659.975306:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869659.975308:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869659.975311:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869659.975354:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325133696:0@lo:400:kworker.0 00000100:00100000:3.0:1788869659.975437:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869659.975495:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869659.975501:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325133952:0@lo:400:kworker.0 00000100:00100000:3.0:1788869659.975536:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869659.975570:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325134080:0@lo:400:kworker.0 00000100:00100000:3.0:1788869659.975628:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869659.975648:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869659.975653:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325134208:0@lo:400:kworker.0 00000100:00100000:3.0:1788869659.975674:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869659.975718:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325133952 00000100:00100000:3.0:1788869659.975726:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325133952 00000100:00100000:3.0:1788869659.975775:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325134208 00000100:00100000:3.0:1788869659.975778:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325134208 00000100:00100000:3.0:1788869659.975794:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869659.975801:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325133952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869659.975852:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325133952:12345-0@lo:400:kworker.0 Request processed in 51us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869659.975859:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869659.975875:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869659.975881:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325134208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869659.975882:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325133824:0@lo:38:kworker.0 00000100:00100000:3.0:1788869659.975909:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325134208:12345-0@lo:400:kworker.0 Request processed in 28us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869659.975910:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869659.975915:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869659.975933:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325134080 00000100:00100000:3.0:1788869659.975937:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325134080 00000100:00100000:0.0:1788869659.975941:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325133696 00000100:00100000:0.0:1788869659.975944:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325133696 00000100:00100000:3.0:1788869659.975952:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325133824 00000100:00100000:3.0:1788869659.975954:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325133824 00000100:00100000:3.0:1788869659.975961:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869659.975968:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325134080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869659.975970:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788869659.975975:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:3648:x1875765325133696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869659.975998:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:3648:x1875765325133696:12345-0@lo:400:kworker.0 Request processed in 22us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869659.976004:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788869659.976539:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2703a8c700 x1875765325134208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869659.976555:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325134208:0@lo:400:kworker.0 00000100:00100000:1.0:1788869659.976577:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325134336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869659.976628:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788869659.976649:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2703a8dc00 x1875765325133952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869659.976659:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325133952:0@lo:400:kworker.0 00000100:00100000:1.0:1788869659.976669:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325133696:0@lo:400:kworker.0 00000100:00100000:0.0:1788869659.976741:0:17103:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788869659.976749:0:17103:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788869659.976818:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325134080:12345-0@lo:400:kworker.0 Request processed in 849us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869659.976826:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869659.976840:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325134336 00000100:00100000:3.0:1788869659.976844:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325134336 00000100:00100000:3.0:1788869659.976860:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869659.976865:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325133824:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788869659.976887:0:17104:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 593 last 0 00000100:00100000:0.0:1788869659.976974:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325134080:0@lo:400:kworker.0 00000100:00100000:1.0:1788869659.977202:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000020:00000080:3.0:1788869659.977203:0:17104:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6cfb9e 00000100:00100000:1.0:1788869659.977209:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325134336:12345-0@lo:41:osp-pre-0-1.0 00000004:00100000:3.0:1788869659.977217:0:17104:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788869659.977224:0:17104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000004:00000024:1.0:1788869659.977233:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788869659.977291:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325134336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869659.977298:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869659.977364:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325134336:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788869659.997939:0:17104:0:(import.c:65:import_set_state_nolock()) ffff8e280a6c2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869659.998052:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765325133824:12345-0@lo:38:kworker.0 Request processed in 21183us (22137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869659.998064:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788869659.998420:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788869659.998432:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788869659.998438:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788869659.998441:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788869659.998468:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005644c0d1): req@ffff8e282f0bf800 x1875765325126912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869659.998493:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325133824:0@lo:38:kworker.0 00000100:00100000:0.0:1788869659.998545:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325134464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869659.998607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869659.998645:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325134464 00000100:00100000:2.0:1788869659.998653:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325134464 00000100:00100000:2.0:1788869659.998705:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869659.998716:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875765325134464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869659.998753:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869659.998795:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875765325134464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869659.998801:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869659.998802:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869659.998817:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869659.998825:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325126912 00000100:00100000:2.0:1788869659.998829:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325126912 00000100:00100000:2.0:1788869659.998845:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869659.998851:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17140:x1875765325126912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788869659.998923:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17140:x1875765325126912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869659.998933:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869659.999115:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17140:1875765325126912:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788869659.999155:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325134464:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1788869659.999161:0:17140:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788869659.999201:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17140:1875765325134592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788869659.999234:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869659.999263:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809f8e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869660.000242:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325134592 00000100:00100000:3.0:1788869660.000254:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325134592 00000100:00100000:3.0:1788869660.000313:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869660.000322:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17140:x1875765325134592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788869660.000481:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17140:x1875765325134592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 160us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.000488:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869660.001671:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17140:1875765325134592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788869660.001792:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17140:1875765325134720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788869660.001866:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869660.001910:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869660.002132:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325134720 00000100:00100000:3.0:1788869660.002140:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325134720 00000100:00100000:3.0:1788869660.002196:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869660.002205:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17140:x1875765325134720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788869660.002294:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17140:x1875765325134720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.002302:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869660.002461:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17140:1875765325134720:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788869660.002637:0:17140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869660.019352:0:17140:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788869660.019460:0:17140:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:2.0:1788869660.019466:0:17140:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788869660.231104:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869660.661309:0:18153:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869660.661908:0:18153:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869661.254093:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869661.651029:0:18203:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869661.654479:0:18203:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788869661.768494:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788869662.289923:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788869663.005135:0:18251:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff38f38020 20000000:00000080:0.0:1788869663.005158:0:18251:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2806340800 uarg=0000000000000000 20000000:01000000:0.0:1788869663.005204:0:18251:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788869663.005215:0:18251:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788869663.005221:0:18251:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788869663.016951:0:18252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788869663.017503:0:18251:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788869663.027713:0:18251:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788869663.027767:0:18251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.027794:0:18251:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa47 expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.027825:0:18251:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb4a expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.027833:0:18251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.027878:0:18251:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfb4a expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.027896:0:18251:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb4a expref: 17 pid: 17091 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869663.027911:0:18251:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18251:1875765325134848:0@lo:104: 00000100:00100000:0.0:1788869663.027992:0:18251:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869663.028053:0:18251:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfa47 expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.028061:0:18251:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa47 expref: 17 pid: 17092 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869663.028069:0:18251:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18251:1875765325134976:0@lo:104: 00000100:00100000:0.0:1788869663.028091:0:18251:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869663.028114:0:18251:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809294240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869663.028251:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325134848 00000100:00100000:1.0:1788869663.028263:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325134848 00000100:00100000:1.0:1788869663.028319:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325134976 00000100:00100000:1.0:1788869663.028322:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325134976 00000100:00100000:1.0:1788869663.028339:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869663.028350:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+4:18251:x1875765325134848:12345-0@lo:104: 00010000:00010000:1.0:1788869663.028377:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028462:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869663.028469:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+4:18251:x1875765325134848:12345-0@lo:104: Request processed in 122us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869663.028561:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869663.028607:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869663.028614:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:18251:x1875765325134976:12345-0@lo:104: 00010000:00010000:1.0:1788869663.028622:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028656:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869663.028660:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:18251:x1875765325134976:12345-0@lo:104: Request processed in 48us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869663.028667:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788869663.028688:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869663.028694:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028702:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869663.028707:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028716:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869663.028723:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869663.028729:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869663.028762:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028768:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869663.028796:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028803:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5600/0x4c16c38a9b6cfb4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb51 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028817:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869663.028821:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028826:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869663.028829:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028836:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869663.028842:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869663.028847:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869663.028858:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028863:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869663.028868:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028874:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a9600/0x4c16c38a9b6cfa47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfa4e expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.028898:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869663.028899:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869663.028901:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869663.028907:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869663.028929:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325135104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869663.028961:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869663.028988:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869663.028993:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325135232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869663.029010:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869663.029034:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325135104 00000100:00100000:1.0:1788869663.029037:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325135104 00010000:00010000:1.0:1788869663.029057:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb4a expref: 18 pid: 17091 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869663.029078:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325135232 00000100:00100000:1.0:1788869663.029081:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325135232 00010000:00010000:1.0:1788869663.029092:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa47 expref: 19 pid: 17092 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869663.029105:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869663.029110:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:3650:x1875765325135104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869663.029120:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869663.029124:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb4a expref: 19 pid: 17091 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029134:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb4a expref: 19 pid: 17091 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029160:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869663.029189:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:3650:x1875765325135104:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869663.029195:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869663.029209:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869663.029215:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:3650:x1875765325135232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869663.029222:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869663.029226:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa47 expref: 18 pid: 17092 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029235:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa47 expref: 18 pid: 17092 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029247:0:17085:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029256:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029269:0:17085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029277:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029283:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029290:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029301:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869663.029306:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029313:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029321:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869663.029331:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869663.029369:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:3650:x1875765325135232:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869663.029376:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869663.029416:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325135232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869663.029424:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325135104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869663.029751:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6cfb51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb4a expref: 17 pid: 17091 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869663.029763:0:18251:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18251:1875765325134848:0@lo:104: 00010000:00010000:0.0:1788869663.029772:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfa4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfa47 expref: 16 pid: 17092 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869663.029790:0:18251:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18251:1875765325134976:0@lo:104: 00010000:00010000:0.0:1788869663.029808:0:18251:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.029817:0:18251:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.029823:0:18251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.029830:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6cfba5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869663.313318:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869664.070491:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869654/real 1788869654] req@ffff8e27028a2680 x1875765325130112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869664 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869664.070525:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e27028a2680 x1875765325130112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869664 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869664.070535:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869654/real 1788869654] req@ffff8e27028a1180 x1875765325129856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869664 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869664.070547:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e27028a1180 x1875765325129856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869664 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869664.070579:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869649/real 1788869649] req@ffff8e2703a8c380 x1875765325127936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869664 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869664.070999:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2703a8c380 x1875765325127936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869664 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869664.071010:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869649/real 1788869649] req@ffff8e2703a8d500 x1875765325128064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869664 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869664.071021:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2703a8d500 x1875765325128064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869664 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788869664.071040:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869664.071095:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788869664.071099:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325130112:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788869664.071105:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8cb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869664.074303:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869664.074310:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869664.074313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869664.074317:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869664.074359:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869664.074362:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788869664.074366:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e282d8cb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869664.074374:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:0.0:1788869664.074381:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788869664.074393:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e282d8cb000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869664.074428:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a0700 x1875765325135872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869664.074451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869664.074454:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869664.074456:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869664.074459:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:0.0:1788869664.074462:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788869664.074468:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e282d8c9000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869664.074481:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a0e00 x1875765325136000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869664.074524:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325135360:0@lo:400:kworker.0 00000100:00100000:0.0:1788869664.074625:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869664.074667:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325136128:0@lo:400:kworker.0 00000100:00100000:0.0:1788869664.074700:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869664.074729:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869664.074735:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325135488:0@lo:400:kworker.0 00000100:00100000:0.0:1788869664.074775:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869664.074806:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325135616:0@lo:400:kworker.0 00000100:00100000:0.0:1788869664.074831:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869664.074849:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869664.074853:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325135744:0@lo:400:kworker.0 00000100:00100000:0.0:1788869664.074875:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869664.075149:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325135360 00000100:00100000:2.0:1788869664.075158:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325135360 00000100:00100000:2.0:1788869664.075209:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788869664.075218:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+16:3648:x1875765325135360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869664.075272:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+16:3648:x1875765325135360:12345-0@lo:400:kworker.0 Request processed in 55us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869664.075278:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788869664.075768:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788869664.075776:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325129856:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788869664.075797:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325135488 00000100:00100000:1.0:1788869664.075801:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325135488 00000100:00100000:1.0:1788869664.075834:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325135744 00000100:00100000:1.0:1788869664.075837:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325135744 00000100:00100000:1.0:1788869664.075853:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869664.075858:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325135488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869664.075903:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325135488:12345-0@lo:400:kworker.0 Request processed in 44us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869664.075909:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869664.076015:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869664.076020:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325135744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869664.076060:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325135744:12345-0@lo:400:kworker.0 Request processed in 39us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869664.076067:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788869664.076084:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282a39b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869664.076091:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788869664.076095:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325127936:0@lo:8:kworker.0 00000100:00080000:1.0:1788869664.076101:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869664.076105:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788869664.076108:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325128064:0@lo:8:kworker.0 00000100:00100000:1.0:1788869664.076141:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325135872:0@lo:8:kworker.0 00000400:00000100:1.0:1788869664.076167:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325135872 offset 0 length 520: 4 00000100:00100000:1.0:1788869664.076182:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325136000:0@lo:8:kworker.0 00000400:00000100:1.0:1788869664.076200:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325136000 offset 0 length 520: 4 00000100:00100000:0.0:1788869664.076532:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325136128 00000100:00100000:0.0:1788869664.076537:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325136128 00000100:00100000:0.0:1788869664.076573:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325135616 00000100:00100000:0.0:1788869664.076577:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325135616 00000100:00100000:0.0:1788869664.076608:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869664.076625:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325136128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869664.076665:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325136128:12345-0@lo:400:kworker.0 Request processed in 42us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869664.076672:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869664.076685:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869664.076691:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325135616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869664.076718:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325135616:12345-0@lo:400:kworker.0 Request processed in 27us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869664.076725:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869664.076781:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325135744:0@lo:400:kworker.0 00010000:00080000:0.0:1788869664.076796:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e27028a1500 x1875765325135616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869664.076807:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325135616:0@lo:400:kworker.0 00000100:00100000:0.0:1788869664.076844:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325135488:0@lo:400:kworker.0 00000100:00100000:0.0:1788869664.076856:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325135360:0@lo:400:kworker.0 00010000:00080000:0.0:1788869664.076868:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e27028a2a00 x1875765325136128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869664.076877:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325136128:0@lo:400:kworker.0 00000100:00080000:2.0:1788869664.077144:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869664.077149:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788869664.077153:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282a39b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869664.077158:0:475:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 583 00000100:00080000:2.0:1788869664.077163:0:475:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788869664.077171:0:475:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e282a39b800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869664.077200:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f0bd880 x1875765325136256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869664.077222:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869664.077225:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788869664.077226:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869664.077230:0:475:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 583 00000100:00080000:2.0:1788869664.077232:0:475:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788869664.077236:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e282db3e000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869664.077248:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f0bf480 x1875765325136384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869664.077283:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325136256:0@lo:8:kworker.0 00000400:00000100:2.0:1788869664.077317:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325136256 offset 0 length 520: 4 00000100:00100000:2.0:1788869664.077352:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325136384:0@lo:8:kworker.0 00000400:00000100:2.0:1788869664.077367:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325136384 offset 0 length 520: 4 10000000:01000000:0.0:1788869664.198000:0:17095:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869664.198012:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282dac7800 from 13 10000000:01000000:0.0:1788869664.198021:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869664.198088:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869664.198112:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869664.198125:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869664.198154:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325136512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869664.198233:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869664.198281:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28092943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869664.198306:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325136512 00000100:00100000:0.0:1788869664.198315:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325136512 00000100:00100000:0.0:1788869664.198388:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788869664.198398:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+16:17095:x1875765325136512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869664.200567:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869664.200631:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfbac expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869664.200677:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbac expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869664.200691:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbac expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869664.200702:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5800, rc 0) 00000100:00100000:0.0:1788869664.200808:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325136512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2410us (2575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869664.200817:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869664.201652:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325136512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869664.201679:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869664.201690:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869664.201785:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325136640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869664.201839:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869664.201897:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0dbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869664.201932:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325136640 00000100:00100000:2.0:1788869664.201939:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325136640 00000100:00100000:2.0:1788869664.201985:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788869664.201995:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325136640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869664.202131:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325136640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869664.202140:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788869664.202180:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325136640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869664.202224:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325136768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869664.202264:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869664.202289:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809f8e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869664.202360:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325136768 00000100:00100000:1.0:1788869664.202366:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325136768 00000100:00100000:1.0:1788869664.202399:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788869664.202406:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325136768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869664.202507:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325136768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869664.202514:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788869664.202555:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325136768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869664.203646:0:18295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788869664.203874:0:17095:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788869664.203902:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869664.203913:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869664.203925:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869664.203938:0:17095:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869664.203941:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e280a5b7800 from 13 10000000:01000000:2.0:1788869664.203945:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869664.203983:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869664.203992:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869664.204003:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869664.204026:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325136896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869664.204090:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869664.204134:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809f8e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869664.204763:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325136896 00000100:00100000:3.0:1788869664.204776:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325136896 00000100:00100000:3.0:1788869664.204846:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869664.204857:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+17:17095:x1875765325136896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869664.204875:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869664.204892:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfbba expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869664.204939:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbba expref: 18 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869664.204952:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbba expref: 18 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869664.204961:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9c00, rc 0) 00000100:00100000:3.0:1788869664.205015:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17095:x1875765325136896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869664.205022:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869664.205071:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325136896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869664.205086:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869664.205096:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869664.205157:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325137024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869664.205182:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869664.205211:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e270369d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869664.205275:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325137024 00000100:00100000:2.0:1788869664.205281:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325137024 00000100:00100000:2.0:1788869664.205314:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869664.205321:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17095:x1875765325137024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869664.205457:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17095:x1875765325137024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869664.205472:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788869664.206352:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325137024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869664.206398:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703911180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325137152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869664.206457:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869664.206495:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809294780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869664.206514:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325137152 00000100:00100000:2.0:1788869664.206519:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325137152 00000100:00100000:2.0:1788869664.206561:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788869664.206570:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17095:x1875765325137152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869664.206705:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:17095:x1875765325137152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869664.206713:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869664.206913:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703911180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325137152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788869664.207792:0:18296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788869664.207958:0:17095:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788869664.207985:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869664.207996:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869664.208018:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869664.339255:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869665.097779:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325137280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869665.097855:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869665.097920:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325137280 00000100:00100000:0.0:1788869665.097929:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325137280 00000100:00100000:0.0:1788869665.097982:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869665.097991:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325137280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869665.098027:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788869665.098074:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325137280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869665.098080:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869665.098457:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325137280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869665.099087:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325137408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869665.099142:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869665.099379:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325137408 00000100:00100000:2.0:1788869665.099386:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325137408 00000100:00100000:2.0:1788869665.099428:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869665.099435:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765325137408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869665.099463:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869665.099505:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765325137408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869665.099511:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869665.099542:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325137408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869665.353002:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788869666.122219:0:17831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788869666.374869:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869666.886524:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788869667.402461:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869668.425179:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869669.191491:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869669.191499:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869669.191502:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869669.191504:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869669.191522:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869669.191534:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869669.191537:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869669.191540:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869669.191877:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325137920:0@lo:400:kworker.0 00000100:00100000:2.0:1788869669.191951:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869669.192003:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788869669.192010:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325137536:0@lo:400:kworker.0 00000100:00100000:2.0:1788869669.192036:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869669.192060:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325138048:0@lo:400:kworker.0 00000100:00100000:2.0:1788869669.192083:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869669.197414:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325137664:0@lo:400:kworker.0 00000100:00100000:0.0:1788869669.197518:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869669.199406:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869669.199448:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325137792:0@lo:400:kworker.0 00000100:00100000:0.0:1788869669.199541:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869669.200161:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325137920 00000100:00100000:0.0:1788869669.200171:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325137920 00000100:00100000:0.0:1788869669.200240:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325137664 00000100:00100000:0.0:1788869669.200245:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325137664 00000100:00100000:0.0:1788869669.200269:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869669.200280:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325137920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869669.204995:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325137920:12345-0@lo:400:kworker.0 Request processed in 4703us (13028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869669.205021:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869669.205070:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869669.205086:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325137664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869669.205172:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325137664:12345-0@lo:400:kworker.0 Request processed in 94us (7655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869669.205179:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869669.205208:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325138048 00000100:00100000:0.0:1788869669.205216:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325138048 00000100:00100000:0.0:1788869669.205262:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325137792 00000100:00100000:0.0:1788869669.205265:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325137792 00000100:00100000:0.0:1788869669.205281:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869669.205287:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325138048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869669.205333:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325138048:12345-0@lo:400:kworker.0 Request processed in 45us (13248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869669.205352:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869669.205364:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869669.205370:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325137792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869669.205401:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325137792:12345-0@lo:400:kworker.0 Request processed in 31us (5860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869669.205408:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788869669.206062:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e282f0bf100 x1875765325138048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869669.206081:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325138048:0@lo:400:kworker.0 00000100:00100000:2.0:1788869669.206095:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325137920:0@lo:400:kworker.0 00010000:00080000:0.0:1788869669.210758:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e282f0be300 x1875765325137792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869669.210782:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325137792:0@lo:400:kworker.0 00000100:00100000:0.0:1788869669.210800:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325137664:0@lo:400:kworker.0 00000100:00100000:3.0:1788869669.213053:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325137536 00000100:00100000:3.0:1788869669.213073:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325137536 00000100:00100000:3.0:1788869669.213141:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788869669.213152:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+18:3650:x1875765325137536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869669.213270:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+18:3650:x1875765325137536:12345-0@lo:400:kworker.0 Request processed in 120us (21232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869669.213293:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788869669.215251:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325137536:0@lo:400:kworker.0 00010000:00010000:1.0:1788869669.446740:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869670.214753:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869670.214775:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325138176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869670.214843:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869670.214889:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325138176 00000100:00100000:1.0:1788869670.214897:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325138176 00000100:00100000:1.0:1788869670.214941:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869670.214950:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325138176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869670.214986:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788869670.216152:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325138176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1196us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869670.216170:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869670.216409:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869670.216423:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325138304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869670.216476:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869670.216518:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325138304 00000100:00100000:3.0:1788869670.216525:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325138304 00000100:00100000:3.0:1788869670.216560:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869670.216569:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325138304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869670.216621:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788869670.216666:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325138304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.216673:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869670.216721:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325138304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869670.216804:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325138176:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869670.471183:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788869671.007272:0:18600:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788869671.007278:0:18600:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788869671.007280:0:18600:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788869671.008704:0:18600:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e2817531000 00000020:01000004:1.0:1788869671.008726:0:18600:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788869671.008743:0:18600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788869671.008760:0:18600:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e28179fb380) 00000020:00000080:1.0:1788869671.009519:0:18600:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788869671.054975:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788869671.055412:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788869671.055698:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788869671.056156:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788869671.056356:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788869671.056528:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788869671.056738:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1788869671.059454:0:18600:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788869671.059996:0:18600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788869671.060012:0:18600:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788869671.060034:0:18600:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4c16c38a9b6cfbcf 00000020:01000004:2.0:1788869671.060042:0:18600:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788869671.060069:0:18600:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788869671.060074:0:18600:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788869671.060080:0:18600:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788869671.060086:0:18600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788869671.060098:0:18600:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e283b57b380) 00000020:00000080:2.0:1788869671.060110:0:18600:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788869671.061673:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869671.061874:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788869671.061881:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788869671.065166:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869671.065179:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788869671.065521:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788869671.065528:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788869671.069098:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869671.069334:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788869671.069354:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788869671.071351:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788869671.071364:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788869671.116363:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869671.117019:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788869671.117028:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788869671.119572:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788869671.120235:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788869671.121499:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788869671.121511:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788869671.125255:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869671.125496:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788869671.125502:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788869671.126544:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788869671.126553:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788869671.186344:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869671.188313:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788869671.188325:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788869671.190180:0:18600:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788869671.190206:0:18600:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788869671.190694:0:18600:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788869671.190741:0:18600:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788869671.190751:0:18600:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788869671.206015:0:18600:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788869671.206071:0:18600:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788869671.206077:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788869671.206079:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869671.206081:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869671.206082:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869671.206083:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869671.206085:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869671.206086:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869671.206089:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869671.206090:0:18600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869671.206094:0:18600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788869671.206097:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869671.206098:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869671.206100:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869671.206101:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869671.206102:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869671.206103:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869671.206104:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869671.206105:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869671.206106:0:18600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869671.206138:0:18600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788869671.206165:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788869671.206294:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.206346:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869671.206415:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325138432 00000100:00100000:3.0:1788869671.206425:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325138432 00000100:00100000:3.0:1788869671.206493:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788869671.206503:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:18600:x1875765325138432:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869671.206547:0:17093:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788869671.206551:0:17093:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788869671.206556:0:17093:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788869671.207105:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:18600:x1875765325138432:12345-0@lo:253:mount.lustre.0 Request processed in 598us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.207116:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869671.207225:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138432:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788869671.207239:0:18600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788869671.207242:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869671.207243:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869671.207245:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869671.207246:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869671.207247:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869671.207248:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869671.207249:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869671.207251:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869671.207252:0:18600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788869671.207274:0:18600:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2817531000 from lustre-OST0000 10000000:01000000:2.0:1788869671.207304:0:18600:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788869671.207308:0:18600:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788869671.207316:0:18600:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e27025e99c0 local copy 00010000:00010000:2.0:1788869671.207327:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869671.207428:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869671.207460:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.207491:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869671.207548:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325138560 00000100:00100000:3.0:1788869671.207555:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325138560 00000100:00100000:0.0:1788869671.207684:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869671.207697:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+18:18600:x1875765325138560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869671.207886:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+18:18600:x1875765325138560:12345-0@lo:501:mount.lustre.0 Request processed in 192us (424us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869671.207894:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869671.214264:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138560:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788869671.214331:0:18600:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788869671.214389:0:18600:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788869671.214401:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.214414:0:18600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869671.214468:0:18600:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2817531000 10000000:01000000:2.0:1788869671.214475:0:18600:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788869671.214482:0:18600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788869671.214485:0:18600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869671.214491:0:18600:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788869671.214494:0:18600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788869671.214540:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.214549:0:18600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.214561:0:18600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869671.214615:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869671.214697:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.214749:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869671.215142:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325138688 00000100:00100000:3.0:1788869671.215154:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325138688 00000100:00100000:3.0:1788869671.215221:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788869671.215233:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+18:18600:x1875765325138688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869671.215249:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869671.215263:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8a00/0x4c16c38a9b6cfbe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfbdd expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.215289:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8a00/0x4c16c38a9b6cfbe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbdd expref: 19 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.215299:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed8a00/0x4c16c38a9b6cfbe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbdd expref: 19 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.215308:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8a00, rc 0) 00000100:00100000:3.0:1788869671.215353:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325138688:12345-0@lo:101:mount.lustre.0 Request processed in 122us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.215360:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869671.215563:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869671.215577:0:18600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.215614:0:18600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869671.217311:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788869671.218266:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869671.224369:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788869671.224458:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788869671.224478:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788869671.224496:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788869671.224513:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788869671.224529:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788869671.224566:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788869671.224574:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788869671.225002:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869671.225090:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.225183:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869671.225248:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325138816 00000100:00100000:3.0:1788869671.225257:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325138816 00000100:00100000:3.0:1788869671.225360:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788869671.225372:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325138816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869671.225617:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325138816:12345-0@lo:501:mount.lustre.0 Request processed in 246us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.225639:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788869671.225778:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869671.225825:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869671.225871:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869671.226142:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829ae3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869671.226231:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325138944 00000100:00100000:2.0:1788869671.226237:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325138944 00000100:00100000:2.0:1788869671.226270:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869671.226278:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325138944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869671.227133:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325138944:12345-0@lo:503:mount.lustre.0 Request processed in 850us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.227144:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788869671.227257:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325138944:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788869671.227801:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788869671.227890:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869671.227944:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869671.227972:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829ae3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869671.228163:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325139072 00000100:00100000:2.0:1788869671.228170:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325139072 00000100:00100000:2.0:1788869671.228211:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869671.228218:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325139072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869671.228583:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325139072:12345-0@lo:502:mount.lustre.0 Request processed in 363us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.228614:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788869671.228933:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788869671.229229:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788869671.229262:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788869671.229278:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788869671.229292:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788869671.229307:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788869671.229320:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788869671.229334:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788869671.229349:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788869671.229364:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788869671.229396:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788869671.229412:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788869671.229427:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788869671.229479:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869671.229538:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869671.229759:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829ae3600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869671.229937:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325139200 00000100:00100000:0.0:1788869671.229943:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325139200 00000100:00100000:3.0:1788869671.230006:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788869671.230017:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325139200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869671.230148:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325139200:12345-0@lo:502:mount.lustre.0 Request processed in 134us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.230156:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788869671.230250:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788869671.230300:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788869671.230309:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788869671.235111:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869671.235126:0:18617:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788869671.235134:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869671.235136:0:18617:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788869671.235143:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869671.235164:0:18617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e283d3e19c0) 00000020:00000080:0.0:1788869671.235210:0:18617:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788869671.235217:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788869671.235317:0:18617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2817531000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788869671.235327:0:18617:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788869671.235337:0:18617:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4c16c38a9b6cfbf2 00010000:00010000:1.0:1788869671.243135:0:18617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788869671.243921:0:18617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788869671.245474:0:18617:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788869671.250803:0:18617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788869671.250817:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869671.250824:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869671.250826:0:18617:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788869671.250830:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788869671.250833:0:18617:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788869671.250834:0:18617:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869671.250836:0:18617:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869671.250837:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788869671.250839:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869671.250841:0:18617:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788869671.250843:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869671.250847:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869671.250848:0:18617:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869671.250851:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869671.250853:0:18617:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788869671.250855:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869671.250858:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869671.250859:0:18617:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788869671.250861:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869671.250863:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869671.250864:0:18617:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788869671.250867:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788869671.250911:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869671.250915:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869671.250923:0:18617:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788869671.250927:0:18617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788869671.251416:0:18600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788869671.251453:0:18600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788869671.251479:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869671.251492:0:18600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869671.251502:0:18600:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2817531000 from 1 10000000:01000000:1.0:1788869671.251505:0:18600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869671.251547:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869671.251555:0:18600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869671.251568:0:18600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869671.251618:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869671.251708:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869671.251750:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a28000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869671.251960:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325139328 00000100:00100000:3.0:1788869671.251969:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325139328 00000100:00100000:3.0:1788869671.252023:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869671.252034:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:18600:x1875765325139328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869671.252049:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869671.252062:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfbf9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.252091:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbf9 expref: 20 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.252103:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbf9 expref: 20 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.252112:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9e00, rc 0) 00000100:00100000:3.0:1788869671.252164:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139328:12345-0@lo:101:mount.lustre.0 Request processed in 133us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.252171:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869671.252237:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869671.252251:0:18600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.252260:0:18600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869671.260381:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788869671.261040:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869671.261291:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788869671.261319:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788869671.261339:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788869671.261345:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788869671.261448:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869671.261536:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869671.261816:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325139456 00000100:00100000:0.0:1788869671.261827:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325139456 00000100:00100000:3.0:1788869671.261933:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869671.263729:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788869671.263750:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869671.263951:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139456:12345-0@lo:501:mount.lustre.0 Request processed in 210us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869671.263960:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788869671.265075:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869671.265224:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869671.265304:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869671.265520:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869671.265560:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325139584 00000100:00100000:1.0:1788869671.265570:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325139584 00000100:00100000:0.0:1788869671.265796:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788869671.265808:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869671.266216:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139584:12345-0@lo:503:mount.lustre.0 Request processed in 410us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869671.266224:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869671.266332:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139584:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788869671.267241:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869671.267367:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869671.267434:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869671.267538:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869671.267755:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325139712 00000100:00100000:1.0:1788869671.267886:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325139712 00000100:00100000:1.0:1788869671.267970:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788869671.267980:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869671.268125:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139712:12345-0@lo:502:mount.lustre.0 Request processed in 146us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869671.268132:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788869671.268261:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869671.268513:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788869671.268549:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788869671.268564:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788869671.268663:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788869671.268682:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788869671.268696:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788869671.268711:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788869671.268725:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788869671.268739:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788869671.268751:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788869671.268861:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788869671.268897:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869671.268951:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.269239:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869671.269321:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325139840 00000100:00100000:3.0:1788869671.269328:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325139840 00000100:00100000:3.0:1788869671.269360:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788869671.269367:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869671.269480:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139840:12345-0@lo:502:mount.lustre.0 Request processed in 113us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.269488:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869671.269576:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869671.269655:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788869671.269664:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788869671.270464:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869671.270476:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869671.270479:0:18621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788869671.270487:0:18621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2817531000 00000020:00000080:2.0:1788869671.270489:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869671.270497:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869671.270500:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869671.270501:0:18621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788869671.270503:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869671.270505:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869671.270507:0:18621:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788869671.270509:0:18621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2817531000 00000020:00000080:2.0:1788869671.270511:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869671.270583:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869671.270611:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869671.270613:0:18621:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788869671.270616:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869671.270628:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869671.270629:0:18621:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869671.270633:0:18621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2817531000 00000020:00000080:2.0:1788869671.270635:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869671.270656:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869671.270659:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869671.270660:0:18621:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869671.270663:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869671.270665:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869671.270666:0:18621:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788869671.270669:0:18621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2817531000 00000020:00000080:2.0:1788869671.270671:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869671.270693:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869671.270695:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869671.270697:0:18621:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788869671.270699:0:18621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788869671.273946:0:18600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788869671.274000:0:18600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869671.274020:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.274035:0:18600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869671.274100:0:18600:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788869671.274103:0:18600:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2817531000 10000000:01000000:2.0:1788869671.274107:0:18600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2817531000 10000000:01000000:2.0:1788869671.274111:0:18600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869671.274118:0:18600:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2817531000 from 1 10000000:01000000:2.0:1788869671.274121:0:18600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869671.274162:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.274181:0:18600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.274203:0:18600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869671.274230:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869671.274295:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.274334:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869671.274996:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325139968 00000100:00100000:1.0:1788869671.275006:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325139968 00000100:00100000:1.0:1788869671.275060:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788869671.275071:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+20:18600:x1875765325139968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869671.275087:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869671.275101:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6cfc0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfc07 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869671.275128:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6cfc0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfc07 expref: 21 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869671.275141:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6cfc0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfc07 expref: 21 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869671.275151:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ee00, rc 0) 00000100:00100000:1.0:1788869671.275225:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325139968:12345-0@lo:101:mount.lustre.0 Request processed in 156us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869671.275242:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869671.275974:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325139968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869671.275995:0:18600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.276005:0:18600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869671.279147:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788869671.279499:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869671.279726:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788869671.279753:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788869671.280148:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788869671.280169:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788869671.280186:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788869671.280215:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788869671.280230:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788869671.280243:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788869671.280258:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788869671.280272:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788869671.280297:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788869671.280312:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788869671.280326:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788869671.280341:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788869671.280356:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788869671.280368:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788869671.280395:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788869671.280411:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788869671.280426:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788869671.280442:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788869671.280455:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788869671.280471:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788869671.280485:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788869671.280498:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788869671.280511:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788869671.280525:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788869671.280538:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788869671.280550:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788869671.280565:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788869671.280578:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788869671.280667:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788869671.280684:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788869671.280713:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788869671.280729:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788869671.280743:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788869671.280755:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788869671.280792:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788869671.280814:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788869671.280819:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788869671.280924:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869671.284943:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.285006:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869671.285112:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325140096 00000100:00100000:0.0:1788869671.285121:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325140096 00000100:00100000:0.0:1788869671.285183:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788869671.285205:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869671.285372:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140096:12345-0@lo:501:mount.lustre.0 Request processed in 180us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869671.285381:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788869671.286950:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869671.287027:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869671.287101:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.287144:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325140224 00000100:00100000:2.0:1788869671.287150:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325140224 00000100:00100000:2.0:1788869671.287205:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788869671.287214:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869671.287317:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140224:12345-0@lo:503:mount.lustre.0 Request processed in 104us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.287326:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788869671.287379:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869671.287392:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140224:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869671.288051:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869671.288137:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869671.288206:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.288244:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325140352 00000100:00100000:2.0:1788869671.288249:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325140352 00000100:00100000:2.0:1788869671.288280:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788869671.288286:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869671.288375:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140352:12345-0@lo:502:mount.lustre.0 Request processed in 88us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.288383:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788869671.288419:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869671.288434:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869671.288648:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788869671.288682:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788869671.288697:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788869671.288712:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788869671.288726:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788869671.288738:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788869671.288752:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788869671.291120:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788869671.291185:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788869671.291235:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788869671.291252:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788869671.291266:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788869671.291280:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788869671.291294:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788869671.291309:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788869671.291323:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788869671.291336:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788869671.291348:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788869671.291360:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788869671.291372:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788869671.291383:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788869671.291395:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788869671.291406:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788869671.291420:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788869671.291445:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788869671.291459:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788869671.291471:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788869671.291483:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788869671.291494:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788869671.291507:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788869671.291521:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788869671.291534:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788869671.291546:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788869671.291558:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788869671.291582:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788869671.291619:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788869671.291631:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788869671.291643:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788869671.291655:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788869671.291666:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788869671.291690:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788869671.291702:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788869671.291713:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788869671.291724:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788869671.291734:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788869671.291744:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788869671.291754:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788869671.291784:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788869671.291845:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869671.291929:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.291978:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325140480 00000100:00100000:2.0:1788869671.291987:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325140480 00000100:00100000:2.0:1788869671.292039:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788869671.292607:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869671.297476:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869671.299752:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140480:12345-0@lo:502:mount.lustre.0 Request processed in 2287us (7811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.299788:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788869671.302746:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140480:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869671.303031:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788869671.303058:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788869671.303095:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140608:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869671.303162:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.303226:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869671.303349:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325140608 00000100:00100000:3.0:1788869671.303357:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325140608 00000100:00100000:3.0:1788869671.303419:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788869671.303428:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869671.303540:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325140608:12345-0@lo:502:mount.lustre.0 Request processed in 113us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.303547:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788869671.304723:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325140608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869671.304981:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788869671.304996:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788869671.310439:0:18626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788869671.310460:0:18626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e283b5799c0) 00000020:00000080:2.0:1788869671.310490:0:18626:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788869671.310619:0:18626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2817531000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788869671.310625:0:18626:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2817531000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788869671.310628:0:18626:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2817531000 3 00010000:00080000:2.0:1788869671.310666:0:18626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282db38800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869671.314272:0:18626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788869671.314514:0:18626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788869671.314569:0:18626:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869671.314609:0:18626:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4c16c38a9b6cfc1c 00000100:00080000:2.0:1788869671.314623:0:18626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869671.314638:0:18626:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e282db38800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869671.314682:0:18626:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f0bf100 x1875765325140736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869671.322094:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325140736:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869671.322184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788869671.322259:0:18626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788869671.324765:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869671.324848:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869671.324851:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869671.324854:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869671.324889:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869671.324894:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869671.324897:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869671.324899:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869671.325031:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325140992:0@lo:400:kworker.0 00000100:00100000:3.0:1788869671.325113:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869671.325159:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869671.325166:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325140864:0@lo:400:kworker.0 00000100:00100000:3.0:1788869671.325207:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869671.325244:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325141120:0@lo:400:kworker.0 00000100:00100000:3.0:1788869671.325270:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869671.325288:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869671.325293:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325141248:0@lo:400:kworker.0 00000100:00100000:3.0:1788869671.325340:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869671.325381:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325140864 00000100:00100000:3.0:1788869671.325389:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325140864 00000100:00100000:3.0:1788869671.325443:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325141120 00000100:00100000:3.0:1788869671.325448:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325141120 00000100:00100000:3.0:1788869671.325466:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869671.325475:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325140864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869671.325535:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325140864:12345-0@lo:400:kworker.0 Request processed in 60us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.325543:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869671.325560:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869671.325567:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325141120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869671.325653:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325141120:12345-0@lo:400:kworker.0 Request processed in 86us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.325659:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869671.325703:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325140864:0@lo:400:kworker.0 00000100:00100000:3.0:1788869671.325730:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325141120:0@lo:400:kworker.0 00000100:00100000:1.0:1788869671.326337:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325140736 00000100:00100000:1.0:1788869671.326345:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325140736 00000100:00100000:1.0:1788869671.326363:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325140992 00000100:00100000:1.0:1788869671.326366:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325140992 00000100:00100000:1.0:1788869671.326384:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325141248 00000100:00100000:1.0:1788869671.326387:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325141248 00000100:00100000:1.0:1788869671.326402:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869671.326410:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325140992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869671.326878:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325140992:12345-0@lo:400:kworker.0 Request processed in 468us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869671.326886:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869671.326905:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869671.326913:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325141248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869671.327031:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325141248:12345-0@lo:400:kworker.0 Request processed in 119us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869671.327038:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869671.327051:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869671.327056:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765325140736:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788869671.327080:0:17099:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 605 last 0 00000020:00000080:1.0:1788869671.327116:0:17099:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4c16c38a9b6cfc23 00000004:00100000:1.0:1788869671.327131:0:17099:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869671.327166:0:17099:0:(import.c:65:import_set_state_nolock()) ffff8e2840eb0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869671.327220:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765325140736:12345-0@lo:38:llog_process_th.0 Request processed in 162us (5036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869671.327237:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788869671.328881:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2703a8c380 x1875765325141248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869671.328904:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325141248:0@lo:400:kworker.0 00010000:00080000:2.0:1788869671.333003:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2703a8fb80 x1875765325140992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869671.333024:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325140992:0@lo:400:kworker.0 00010000:00080000:2.0:1788869671.333075:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e282f0bf100 x1875765325140736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869671.333108:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869671.333119:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788869671.333128:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788869671.333134:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869671.333137:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db38800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869671.333144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325140736:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1788869671.333291:0:18626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788869671.333308:0:18626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8e283b57cd40) 00000020:00000080:2.0:1788869671.333331:0:18626:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788869671.333441:0:18626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2817531000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788869671.333446:0:18626:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2817531000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788869671.333448:0:18626:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2817531000 3 00010000:00080000:2.0:1788869671.333475:0:18626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2804fbd000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869671.338107:0:18626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788869671.338371:0:18626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788869671.338420:0:18626:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869671.338436:0:18626:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4c16c38a9b6cfc31 00000100:00080000:2.0:1788869671.339668:0:18626:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869671.339683:0:18626:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e2804fbd000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869671.343216:0:18626:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a8c380 x1875765325141376/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869671.343253:0:18626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788869671.343411:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869671.343417:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869671.343421:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869671.343424:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869671.343428:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869671.343431:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869671.343433:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869671.343436:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869671.343555:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765325141376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869671.343693:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788869671.344237:0:18626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788869671.344603:0:18600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788869671.344638:0:18600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869671.344658:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.344683:0:18600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788869671.344746:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788869671.344749:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869671.344750:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869671.344752:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869671.344753:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869671.344755:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869671.344756:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869671.344758:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869671.344760:0:18600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869671.344764:0:18600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788869671.344767:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869671.344768:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869671.344776:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869671.344778:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869671.345000:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869671.345003:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869671.345004:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869671.345006:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869671.345007:0:18600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869671.345034:0:18600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788869671.345051:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325141504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788869671.345116:0:18600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869671.345145:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809e27300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869671.345287:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325141504 00000100:00100000:2.0:1788869671.345295:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325141504 00000100:00100000:2.0:1788869671.345336:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869671.345348:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325141504:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788869671.345394:0:17091:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788869671.345409:0:17091:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788869671.349058:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325141376 00000100:00100000:1.0:1788869671.349073:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325141376 00000100:00100000:1.0:1788869671.349135:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869671.349143:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765325141376:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788869671.349178:0:17099:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 605 last 0 00000020:00000080:1.0:1788869671.349248:0:17099:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4c16c38a9b6cfc38 00000004:00100000:1.0:1788869671.349266:0:17099:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869671.349304:0:17099:0:(import.c:65:import_set_state_nolock()) ffff8e2840eb4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869671.350901:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765325141376:12345-0@lo:38:llog_process_th.0 Request processed in 1743us (7195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869671.350916:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788869671.356433:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2703a8c380 x1875765325141376/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869671.356452:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869671.356466:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788869671.356479:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788869671.356488:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788869671.356514:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2804fbd000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869671.356522:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765325141376:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788869671.360922:0:17091:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788869671.360950:0:17091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788869671.362684:0:17114:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788869671.362695:0:17114:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788869671.362721:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.362744:0:17114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb82 expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.362752:0:17114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb90 expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.362770:0:17114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869671.362774:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:18600:x1875765325141504:12345-0@lo:253:mount.lustre.0 Request processed in 17420us (17650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869671.362784:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1788869671.362818:0:17114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfb90 expref: 20 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.362833:0:17114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb90 expref: 20 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869671.362846:0:17114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325141632:0@lo:104: 00000100:00100000:2.0:1788869671.362884:0:17114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869671.362939:0:17114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfb82 expref: 20 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.362947:0:17114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb82 expref: 20 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869671.362965:0:17114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325141760:0@lo:104: 00000100:00100000:2.0:1788869671.363001:0:17114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.363022:0:17114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869671.363046:0:17081:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788869671.363063:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325141632 00000100:00100000:2.0:1788869671.363070:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325141632 00000100:00100000:2.0:1788869671.363098:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325141760 00000100:00100000:2.0:1788869671.363100:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325141760 00000100:00100000:2.0:1788869671.363111:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869671.363119:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+4:17114:x1875765325141632:12345-0@lo:104: 00010000:00010000:2.0:1788869671.363133:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363179:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869671.363185:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+4:17114:x1875765325141632:12345-0@lo:104: Request processed in 67us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.363202:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869671.363217:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869671.363222:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:17114:x1875765325141760:12345-0@lo:104: 00010000:00010000:2.0:1788869671.363229:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363261:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869671.363266:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280881d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:17114:x1875765325141760:12345-0@lo:104: Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.363272:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788869671.363308:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869671.363314:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363330:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869671.363335:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363343:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869671.363350:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869671.363356:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869671.363386:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363393:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869671.363418:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363425:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840eda400/0x4c16c38a9b6cfb90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb97 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363436:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869671.363439:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363445:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869671.363448:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363464:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869671.363470:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869671.363476:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869671.363488:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363493:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869671.363500:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363506:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfb82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfb89 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363517:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869671.363519:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869671.363520:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869671.363528:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869671.363549:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325141888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869671.363580:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.363620:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869671.363626:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325142016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869671.363650:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869671.363688:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325141888 00000100:00100000:2.0:1788869671.363693:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325141888 00010000:00010000:2.0:1788869671.363720:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb90 expref: 21 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869671.363742:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325142016 00000100:00100000:2.0:1788869671.363746:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325142016 00010000:00010000:2.0:1788869671.363757:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb82 expref: 22 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869671.363769:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869671.363774:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:3650:x1875765325141888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869671.363785:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869671.363789:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb90 expref: 22 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363800:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb90 expref: 22 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363815:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869671.363843:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:3650:x1875765325141888:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.363849:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869671.363863:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869671.363869:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27025f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:3650:x1875765325142016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869671.363877:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869671.363881:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb82 expref: 21 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363889:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb82 expref: 21 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363908:0:17084:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363916:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869671.363930:0:17084:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006062804s 00010000:00010000:2.0:1788869671.363934:0:17084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363942:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363948:0:17084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363955:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363960:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869671.363964:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363972:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363981:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.363991:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869671.364015:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27025f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:3650:x1875765325142016:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.364027:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869671.364098:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325142016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869671.364107:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325141888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869671.364139:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb4200/0x4c16c38a9b6cfb97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb90 expref: 20 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869671.364148:0:17114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325141632:0@lo:104: 00010000:00010000:2.0:1788869671.364156:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed8c00/0x4c16c38a9b6cfb89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfb82 expref: 19 pid: 17091 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869671.364162:0:17114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325141760:0@lo:104: 00010000:00010000:2.0:1788869671.364173:0:17114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.364181:0:17114:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.364187:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.364207:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6cfc3f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869671.364888:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:18600:1875765325141504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788869671.364904:0:18600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788869671.364914:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788869671.364916:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869671.364918:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869671.364919:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869671.364921:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869671.364922:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869671.364924:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869671.364926:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869671.364927:0:18600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788869671.365013:0:18600:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788869671.377792:0:18600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788869671.381936:0:18600:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788869671.382022:0:18600:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788869671.382062:0:18600:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788869671.382109:0:18600:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788869671.382130:0:18600:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788869671.382158:0:18600:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788869671.383008:0:18600:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869671.383230:0:18600:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869671.494810:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869672.012939:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788869672.405500:0:18681:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869672.408863:0:18681:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869672.518145:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869672.657372:0:17095:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869672.657382:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e282dac7800 from 9 10000000:01000000:2.0:1788869672.657389:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869672.657449:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.657472:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.657487:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869672.657517:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325142144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869672.657632:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869672.657675:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869672.657893:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325142144 00000100:00100000:2.0:1788869672.657902:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325142144 00000100:00100000:2.0:1788869672.657953:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788869672.657962:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+19:17095:x1875765325142144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869672.657975:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869672.657988:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfc46 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.658012:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfc46 expref: 20 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.658533:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfc46 expref: 20 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.658544:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda400, rc 0) 00000100:00100000:2.0:1788869672.659091:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+20:17095:x1875765325142144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 785us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869672.659101:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788869672.659192:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325142144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869672.659211:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.659222:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869672.659278:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325142272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869672.659314:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869672.659339:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869672.659352:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325142272 00000100:00100000:2.0:1788869672.659357:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325142272 00000100:00100000:2.0:1788869672.659382:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788869672.659388:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+20:17095:x1875765325142272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869672.659403:0:17091:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869672.659419:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869672.659422:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788869672.659485:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+20:17095:x1875765325142272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869672.659492:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788869672.659521:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325142272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869672.660109:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869672.660118:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.660128:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869672.660148:0:17095:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869672.660151:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e280a5b7800 from 9 10000000:01000000:2.0:1788869672.660153:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869672.660189:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.660197:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.660206:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869672.660221:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325142400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869672.660255:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869672.660280:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869672.660296:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325142400 00000100:00100000:2.0:1788869672.660301:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325142400 00000100:00100000:2.0:1788869672.660328:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788869672.660336:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+20:17095:x1875765325142400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869672.660345:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869672.660356:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfc54 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.660375:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfc54 expref: 21 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.660385:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfc54 expref: 21 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.660404:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edac00, rc 0) 00000100:00100000:2.0:1788869672.660432:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+21:17095:x1875765325142400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869672.660438:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788869672.660468:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325142400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869672.660478:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.660486:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869672.660519:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325142528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869672.660542:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869672.660552:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869672.660562:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325142528 00000100:00100000:2.0:1788869672.660565:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325142528 00000100:00100000:2.0:1788869672.664710:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869672.664735:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:17095:x1875765325142528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869672.664848:0:17092:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869672.664869:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869672.664872:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788869672.665019:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:17095:x1875765325142528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 295us (4475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869672.665027:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869672.665090:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325142528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869672.665176:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869672.665187:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869672.665197:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869673.546031:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869674.565831:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869675.334004:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325142656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869675.334148:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869675.334258:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325142656 00000100:00100000:3.0:1788869675.334268:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325142656 00000100:00100000:3.0:1788869675.334323:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788869675.334333:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325142656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869675.334377:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788869675.334427:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325142656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869675.334434:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869675.334637:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325142656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869675.335957:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869675.335983:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325142784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869675.336048:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869675.336257:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325142784 00000100:00100000:0.0:1788869675.336265:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325142784 00000100:00100000:0.0:1788869675.336310:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869675.336320:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325142784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869675.336356:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788869675.336430:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325142784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869675.336438:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869675.336526:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325142784:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869675.595844:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869676.105848:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788869676.358375:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869676.358382:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869676.358395:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869676.358399:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869676.358422:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869676.358426:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869676.358428:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869676.358432:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869676.358471:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325143040:0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.358633:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869676.358679:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325143552:0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.358708:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869676.358735:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788869676.358742:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325142912:0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.358769:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869676.358791:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325143424:0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.358811:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869676.358836:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325143168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.358859:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869676.358876:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325143680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.358894:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869676.358903:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869676.358908:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325143296:0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.358925:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869676.358959:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325143040 00000100:00100000:3.0:1788869676.358968:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325143040 00000100:00100000:3.0:1788869676.359015:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325143296 00000100:00100000:3.0:1788869676.359018:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325143296 00000100:00100000:3.0:1788869676.359035:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869676.359045:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325143040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.359119:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325143040:12345-0@lo:400:kworker.0 Request processed in 75us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869676.359127:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869676.359148:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869676.359154:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325143296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.359196:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325143296:12345-0@lo:400:kworker.0 Request processed in 41us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869676.359202:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869676.359224:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325143552 00000100:00100000:3.0:1788869676.359228:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325143552 00000100:00100000:3.0:1788869676.359256:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325143424 00000100:00100000:3.0:1788869676.359259:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325143424 00000100:00100000:3.0:1788869676.359268:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325143168 00000100:00100000:3.0:1788869676.359270:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325143168 00000100:00100000:3.0:1788869676.359279:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325143680 00000100:00100000:3.0:1788869676.359281:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325143680 00000100:00100000:3.0:1788869676.359294:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869676.359299:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325143552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.359328:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325143552:12345-0@lo:400:kworker.0 Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869676.359334:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869676.359344:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869676.359350:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325143424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.359374:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325143424:12345-0@lo:400:kworker.0 Request processed in 25us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869676.359380:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869676.359389:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869676.359394:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325143168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.359416:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325143168:12345-0@lo:400:kworker.0 Request processed in 21us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869676.359421:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869676.359431:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869676.359442:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325143680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.359467:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325143680:12345-0@lo:400:kworker.0 Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869676.359473:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869676.359491:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325142912 00000100:00100000:3.0:1788869676.359508:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325142912 00000100:00100000:3.0:1788869676.359533:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788869676.359540:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:3651:x1875765325142912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.359567:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:3651:x1875765325142912:12345-0@lo:400:kworker.0 Request processed in 28us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869676.359573:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788869676.359639:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869676.359644:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869676.359676:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325143296:0@lo:400:kworker.0 00010000:00080000:3.0:1788869676.359689:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703a8d500 x1875765325143168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869676.359701:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325143168:0@lo:400:kworker.0 00010000:00080000:3.0:1788869676.359712:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703ba9180 x1875765325143680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869676.359720:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325143680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.359754:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325142912:0@lo:400:kworker.0 00010000:00080000:3.0:1788869676.359764:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703a8fb80 x1875765325143424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869676.359772:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325143424:0@lo:400:kworker.0 00000100:00100000:3.0:1788869676.359793:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325143040:0@lo:400:kworker.0 00010000:00080000:3.0:1788869676.359802:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703baa680 x1875765325143552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869676.359811:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325143552:0@lo:400:kworker.0 00010000:00010000:2.0:1788869676.614129:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869677.642103:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869678.661806:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869679.162472:0:18970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788869679.561785:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869664/real 1788869664] req@ffff8e27028a0700 x1875765325135872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869679 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869679.561818:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e27028a0700 x1875765325135872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869679 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869679.561828:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869664/real 1788869664] req@ffff8e27028a0e00 x1875765325136000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869679 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869679.561838:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e27028a0e00 x1875765325136000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869679 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869679.561859:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8cb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869679.561879:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788869679.561883:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325135872:0@lo:8:kworker.0 00000100:00080000:3.0:1788869679.561889:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869679.561894:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788869679.561897:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325136000:0@lo:8:kworker.0 00000100:00080000:3.0:1788869679.561985:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869679.561989:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869679.561992:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869679.562002:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869679.562019:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869679.562022:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788869679.562025:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282d8cb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869679.562040:0:475:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 597 00000100:00080000:3.0:1788869679.562046:0:475:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788869679.562056:0:475:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e282d8cb000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869679.562077:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703baa300 x1875765325144320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869679.562090:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869679.562092:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788869679.562094:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869679.562097:0:475:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 597 00000100:00080000:3.0:1788869679.562099:0:475:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788869679.562103:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e282d8c9000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869679.562112:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703bab100 x1875765325144448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869679.562152:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325143808:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562241:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.562287:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325144576:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562316:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.562339:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869679.562344:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325144192:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562367:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.562406:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325143936:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562430:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.562447:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325144704:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562469:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.562487:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788869679.562493:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325144064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562516:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.562536:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325144832:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562557:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.562584:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325143808 00000100:00100000:3.0:1788869679.562611:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325143808 00000100:00100000:3.0:1788869679.562654:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788869679.562662:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+21:3649:x1875765325143808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562710:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+21:3649:x1875765325143808:12345-0@lo:400:kworker.0 Request processed in 49us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.562717:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788869679.562749:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325144576 00000100:00100000:3.0:1788869679.562752:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325144576 00000100:00100000:3.0:1788869679.562771:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325144704 00000100:00100000:3.0:1788869679.562774:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325144704 00000100:00100000:3.0:1788869679.562798:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325144064 00000100:00100000:3.0:1788869679.562800:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325144064 00000100:00100000:3.0:1788869679.562811:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325144832 00000100:00100000:3.0:1788869679.562813:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325144832 00000100:00100000:3.0:1788869679.562826:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869679.562832:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325144576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562865:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325144576:12345-0@lo:400:kworker.0 Request processed in 33us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.562882:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869679.562895:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869679.562900:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325144704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562933:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325144704:12345-0@lo:400:kworker.0 Request processed in 32us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.562939:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869679.562950:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869679.562956:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325144064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.562982:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325144064:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.562987:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869679.562997:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869679.563002:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325144832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.563026:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325144832:12345-0@lo:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.563045:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869679.563064:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325144192 00000100:00100000:3.0:1788869679.563068:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325144192 00000100:00100000:3.0:1788869679.563097:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325143936 00000100:00100000:3.0:1788869679.563099:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325143936 00000100:00100000:3.0:1788869679.563109:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869679.563115:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325144192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.563147:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325144192:12345-0@lo:400:kworker.0 Request processed in 32us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.563152:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869679.563170:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869679.563175:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325143936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.563218:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325143936:12345-0@lo:400:kworker.0 Request processed in 43us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.563225:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788869679.563258:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869679.563263:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788869679.563287:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703ba9f80 x1875765325144064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869679.563301:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325144064:0@lo:400:kworker.0 00010000:00080000:3.0:1788869679.563311:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703baad80 x1875765325144832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869679.563319:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325144832:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.563327:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325143936:0@lo:400:kworker.0 00010000:00080000:3.0:1788869679.563335:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703ba8700 x1875765325144704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869679.563342:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325144704:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.563378:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325144192:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.563386:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325143808:0@lo:400:kworker.0 00010000:00080000:3.0:1788869679.563395:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703ba9500 x1875765325144576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869679.563402:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325144576:0@lo:400:kworker.0 00000100:00100000:3.0:1788869679.563434:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325144320:0@lo:8:kworker.0 00000100:00100000:3.0:1788869679.563499:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.563532:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325144320 00000100:00100000:3.0:1788869679.563536:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325144320 00000100:00100000:3.0:1788869679.563576:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869679.563581:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325144320:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788869679.563627:0:18604:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 613 last 0 00000020:00000080:3.0:1788869679.563654:0:18604:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6cfc62 00002000:00100000:3.0:1788869679.563665:0:18604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e27029d1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788869679.563670:0:18604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788869679.563672:0:18604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788869679.563860:0:18604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788869679.563884:0:18604:0:(import.c:65:import_set_state_nolock()) ffff8e27029d6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869679.563921:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765325144320:12345-0@lo:8:kworker.0 Request processed in 338us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.563928:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788869679.563955:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703baa300 x1875765325144320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869679.563963:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869679.563970:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788869679.563979:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788869679.563985:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788869679.563987:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8cb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788869679.564004:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788869679.564009:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325144320:0@lo:8:kworker.0 00000004:00080000:3.0:1788869679.564024:0:17839:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788869679.564113:0:17839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 613477525358ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788869679.564121:0:17839:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788869679.564156:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325144448:0@lo:8:kworker.0 00000100:00100000:3.0:1788869679.564188:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.564209:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325144448 00000100:00100000:3.0:1788869679.564213:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325144448 00000100:00100000:3.0:1788869679.564226:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869679.564231:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325144448:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788869679.564246:0:18606:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:1.0:1788869679.564810:0:17840:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788869679.564836:0:17840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17840:1875765325145088:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788869679.564874:0:17840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869679.564892:0:17840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869679.564911:0:18605:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788869679.564917:0:18605:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788869679.566013:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325144960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869679.566085:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869679.566139:0:18604:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788869679.566149:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325145088 00000100:00100000:1.0:1788869679.566258:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325144960 00000100:00100000:1.0:1788869679.566263:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325144960 00000100:00100000:1.0:1788869679.566321:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869679.566331:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875765325144960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869679.566366:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788869679.566414:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875765325144960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.566420:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869679.566459:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325145088 00010000:00080000:0.0:1788869679.566504:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e28179e4380 x1875765325144960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869679.566523:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325144960:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788869679.568343:0:17831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:0.0:1788869679.575931:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869679.576987:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869679.577006:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17840:x1875765325145088:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788869679.584469:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325144448:12345-0@lo:8:kworker.0 Request processed in 20229us (20272us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788869679.584489:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788869679.584552:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869679.584558:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788869679.584563:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325144448:0@lo:8:kworker.0 00002000:00080000:0.0:1788869679.586402:0:18991:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788869679.586411:0:18991:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788869679.586510:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17840:x1875765325145088:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9508us (21631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.586521:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788869679.586884:0:17840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e28179e4000 x1875765325145088/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869695 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869679.586901:0:17840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17840:1875765325145088:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788869679.586917:0:17840:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788869679.586974:0:17840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17840:1875765325145216:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788869679.587026:0:17840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869679.587066:0:17840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869679.587108:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325145216 00000100:00100000:3.0:1788869679.587125:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325145216 00000100:00100000:3.0:1788869679.587300:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869679.587310:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17840:x1875765325145216:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788869679.587346:0:18604:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788869679.587388:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17840:x1875765325145216:12345-0@lo:5:osp-pre-0-1.0 Request processed in 80us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.587394:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788869679.587462:0:17840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e28179e4000 x1875765325145216/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869695 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869679.587473:0:17840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17840:1875765325145216:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788869679.587482:0:17840:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788869679.587512:0:17840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17840:1875765325145344:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788869679.587537:0:17840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869679.587562:0:17840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869679.587639:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325145344 00000100:00100000:3.0:1788869679.587643:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325145344 00000100:00100000:3.0:1788869679.587676:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869679.587684:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17840:x1875765325145344:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788869679.587721:0:18606:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1788869679.615914:0:18601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788869679.615931:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788869679.616333:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17840:x1875765325145344:12345-0@lo:5:osp-pre-0-1.0 Request processed in 28644us (28789us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788869679.616347:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788869679.617540:0:17840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e28179e4000 x1875765325145344/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869695 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869679.617556:0:17840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788869679.617564:0:17840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17840:1875765325145344:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788869679.617614:0:17840:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788869679.617677:0:17840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17840:1875765325145472:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788869679.617732:0:17840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869679.617778:0:17840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2814159480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869679.618143:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325145472 00000100:00100000:0.0:1788869679.618153:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325145472 00000100:00100000:0.0:1788869679.618199:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869679.618210:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17840:x1875765325145472:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788869679.618357:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17840:x1875765325145472:12345-0@lo:900:osp-pre-0-1.0 Request processed in 148us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.618380:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788869679.618446:0:17840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282f0bd180 x1875765325145472/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869695 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869679.618458:0:17840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17840:1875765325145472:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788869679.686039:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788869680.342571:0:19024:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869680.343156:0:19024:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788869680.456336:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869680.456426:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869680.456449:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325145728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869680.456622:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869680.456709:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325145728 00000100:00100000:3.0:1788869680.456719:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325145728 00000100:00100000:3.0:1788869680.456780:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869680.456791:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325145728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869680.456838:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788869680.456894:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325145728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869680.456902:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869680.458090:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325145728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869680.461339:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325145600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869680.461434:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869680.461640:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325145600 00000100:00100000:3.0:1788869680.461651:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325145600 00000100:00100000:3.0:1788869680.461717:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869680.461731:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325145600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869680.461772:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788869680.461826:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325145600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869680.461834:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869680.462109:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325145600:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869680.712202:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869681.305344:0:19074:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869681.305545:0:19074:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869681.735407:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869682.246346:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788869682.759419:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869683.783042:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869684.678740:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869664/real 1788869664] req@ffff8e282f0bd880 x1875765325136256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869684.678779:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e282f0bd880 x1875765325136256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869684.678790:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869664/real 1788869664] req@ffff8e282f0bf480 x1875765325136384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869684.678831:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e282f0bf480 x1875765325136384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788869684.678856:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282a39b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869684.678887:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788869684.678893:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325136256:0@lo:8:kworker.0 00000100:00080000:1.0:1788869684.678899:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869684.678906:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788869684.678909:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325136384:0@lo:8:kworker.0 00000100:00080000:3.0:1788869684.679157:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869684.679161:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788869684.679164:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282a39b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869684.679168:0:475:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 597 00000100:00080000:3.0:1788869684.679175:0:475:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788869684.679192:0:475:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e282a39b800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869684.679214:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703ba9500 x1875765325146112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869684.679225:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869684.679228:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788869684.679230:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869684.679233:0:475:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 597 00000100:00080000:3.0:1788869684.679236:0:475:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788869684.679239:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e282db3e000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869684.679248:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703baa680 x1875765325146240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869684.679274:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869684.679277:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788869684.679279:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869684.679283:0:475:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 613 00000100:00080000:3.0:1788869684.679286:0:475:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788869684.679291:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e282d8c9000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869684.679301:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703baad80 x1875765325146752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869684.679352:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325146368:0@lo:400:kworker.0 00000100:00100000:3.0:1788869684.679437:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869684.679502:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325147008:0@lo:400:kworker.0 00000100:00100000:1.0:1788869684.679621:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325145856:0@lo:400:kworker.0 00000100:00100000:1.0:1788869684.679659:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869684.679686:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325146624:0@lo:400:kworker.0 00000100:00100000:1.0:1788869684.679710:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869684.679734:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788869684.679739:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325146496:0@lo:400:kworker.0 00000100:00100000:1.0:1788869684.679765:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869684.679786:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325147136:0@lo:400:kworker.0 00000100:00100000:2.0:1788869684.679860:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325146368 00000100:00100000:2.0:1788869684.679870:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325146368 00000100:00100000:2.0:1788869684.679923:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869684.679945:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325146368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869684.685977:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869684.686038:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788869684.686433:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869684.686461:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325146368:12345-0@lo:400:kworker.0 Request processed in 6525us (7019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869684.686476:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869684.686511:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325147008 00000100:00100000:1.0:1788869684.686511:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325145856 00000100:00100000:2.0:1788869684.686520:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325147008 00000100:00100000:1.0:1788869684.686521:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325145856 00000100:00100000:2.0:1788869684.686577:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325147136 00000100:00100000:2.0:1788869684.686581:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325147136 00000100:00100000:1.0:1788869684.686614:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869684.686627:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:3651:x1875765325145856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869684.686631:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869684.686644:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325147008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869684.686711:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:3651:x1875765325145856:12345-0@lo:400:kworker.0 Request processed in 89us (7051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869684.686730:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869684.686769:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325146624 00000100:00100000:1.0:1788869684.686773:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325146624 00000100:00100000:1.0:1788869684.686818:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869684.686826:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325146624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869684.686869:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325146624:12345-0@lo:400:kworker.0 Request processed in 44us (7158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869684.686876:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869684.687183:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325145984:0@lo:400:kworker.0 00000100:00100000:3.0:1788869684.687232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869684.687260:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325146880:0@lo:400:kworker.0 00000100:00100000:1.0:1788869684.687265:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325146496 00000100:00100000:1.0:1788869684.687271:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325146496 00000100:00100000:3.0:1788869684.687291:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869684.687307:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325145984 00010000:00080000:3.0:1788869684.687329:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703ba9880 x1875765325146368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869684.687347:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325146368:0@lo:400:kworker.0 00010000:00080000:3.0:1788869684.687364:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da89500 x1875765325147008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869684.687374:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325147008:0@lo:400:kworker.0 00000100:00100000:3.0:1788869684.687415:0:17100:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869684.687425:0:17100:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788869684.687448:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869684.687456:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325146496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869684.687493:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325146496:12345-0@lo:400:kworker.0 Request processed in 39us (7727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869684.687500:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869684.687536:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325145984 00000100:00100000:1.0:1788869684.687560:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869684.687567:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325145984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869684.687627:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325145984:12345-0@lo:400:kworker.0 Request processed in 60us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869684.687640:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869684.687682:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325146112:0@lo:8:kworker.0 00000100:00100000:1.0:1788869684.687717:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869684.688024:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325146240:0@lo:8:kworker.0 00000100:00100000:1.0:1788869684.688056:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869684.688075:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325146752:0@lo:8:kworker.0 00000100:00100000:1.0:1788869684.688096:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869684.688126:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325146112 00000100:00100000:1.0:1788869684.688130:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325146112 00000100:00100000:1.0:1788869684.688146:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325146240 00000100:00100000:1.0:1788869684.688158:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325146240 00000100:00100000:1.0:1788869684.688169:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325146752 00000100:00100000:1.0:1788869684.688171:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325146752 00000100:00100000:1.0:1788869684.688180:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869684.688185:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765325146112:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788869684.688218:0:18991:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:1.0:1788869684.688253:0:18991:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6cfc69 00002000:00100000:1.0:1788869684.688268:0:18991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e2827a92000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788869684.688272:0:18991:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788869684.688275:0:18991:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788869684.688425:0:18991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788869684.688453:0:18991:0:(import.c:65:import_set_state_nolock()) ffff8e2827a96800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869684.688504:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765325146112:12345-0@lo:8:kworker.0 Request processed in 317us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869684.688511:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869684.688526:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869684.688530:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765325146240:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788869684.688541:0:18991:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869684.688911:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325147008:12345-0@lo:400:kworker.0 Request processed in 2269us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869684.688920:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869684.688950:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325146880 00000100:00100000:2.0:1788869684.688955:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325146880 00000100:00100000:2.0:1788869684.688976:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869684.688984:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325147136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869684.689028:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325147136:12345-0@lo:400:kworker.0 Request processed in 45us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869684.689034:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869684.689046:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869684.689053:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325146880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869684.689094:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325146880:12345-0@lo:400:kworker.0 Request processed in 42us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869684.689101:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788869684.689125:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869684.689130:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869684.689132:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788869684.690420:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703ba9500 x1875765325146112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869684.690447:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869684.690460:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788869684.690470:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869684.690476:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788869684.690479:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282a39b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869684.690503:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788869684.690523:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325146112:0@lo:8:kworker.0 00000004:00080000:0.0:1788869684.690562:0:17122:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788869684.690676:0:17122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 618604088538ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788869684.690684:0:17122:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788869684.692306:0:17123:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788869684.692338:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da89f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17123:1875765325147392:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788869684.692434:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869684.692460:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869684.693254:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325145984:0@lo:400:kworker.0 00010000:00080000:3.0:1788869684.693272:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703ba9f80 x1875765325146880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869684.693303:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325146880:0@lo:400:kworker.0 00000100:00100000:3.0:1788869684.693344:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325147264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869684.693379:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869684.693415:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325146496:0@lo:400:kworker.0 00010000:00080000:3.0:1788869684.693426:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da88a80 x1875765325147136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869684.693435:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325147136:0@lo:400:kworker.0 00000100:00100000:3.0:1788869684.693446:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325145856:0@lo:400:kworker.0 00010000:00080000:3.0:1788869684.693458:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703ba9180 x1875765325146624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869684.693466:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325146624:0@lo:400:kworker.0 00000100:00100000:3.0:1788869684.695038:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325147264 00000100:00100000:3.0:1788869684.695063:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325147264 00000100:00100000:3.0:1788869684.695711:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869684.695725:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325147264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869684.696451:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788869684.696915:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325147264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1190us (3531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869684.696925:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788869684.696972:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788869684.697275:0:17078:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:0.0:1788869684.697338:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da89500 x1875765325147264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869684.697361:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325147264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869684.699965:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325147392 00000100:00100000:2.0:1788869684.699979:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325147392 00000100:00100000:2.0:1788869684.700031:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869684.700039:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325146752:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788869684.700063:0:18606:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869684.700159:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325146752:12345-0@lo:8:kworker.0 Request processed in 120us (12061us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869684.700166:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869684.700182:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869684.700188:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17123:x1875765325147392:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788869684.705396:0:18606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788869684.705409:0:18606:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788869684.705416:0:18606:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00080000:0.0:1788869684.705608:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869684.705616:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788869684.705621:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325146752:0@lo:8:kworker.0 00000100:00100000:1.0:1788869684.720444:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765325146240:12345-0@lo:8:kworker.0 Request processed in 31906us (32381us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869684.720457:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788869684.720787:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869684.720794:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788869684.720798:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325146240:0@lo:8:kworker.0 00002000:00010000:3.0:1788869684.747098:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869684.747115:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.747146:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=618s v=(0 0) 00010000:00010000:3.0:1788869684.747152:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869684.747160:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.747185:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.747199:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.747209:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.747241:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869684.747472:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869684.747482:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.747493:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869684.747498:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.747521:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.747544:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.747551:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfc70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.747573:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869684.747575:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869684.747577:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.751432:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.751454:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.751476:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.751482:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.751490:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.751511:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.751524:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.751539:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.751572:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869684.751883:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.751892:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.751901:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.751906:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.751924:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.751964:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.751973:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2085a76/0x4c16c38a9b6cfc77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.751996:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.751999:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.752001:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.753331:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.753346:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.753361:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.753366:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.753371:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.753386:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.753397:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.753405:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.753479:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869684.755821:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869684.755839:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.755858:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=618s v=(0 0) 00010000:00010000:3.0:1788869684.755864:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869684.755871:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.755888:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.755911:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.755919:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759275:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869684.759292:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759308:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbe00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.759314:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759326:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759351:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759374:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6cfc7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759395:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.759399:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759406:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.759409:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759416:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759426:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.759433:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.759434:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.759436:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.761383:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788869684.761402:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfc85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.762687:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.763290:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.763312:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.763329:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.763335:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.763342:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.763362:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.763373:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.763381:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.763404:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869684.764046:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.764054:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764083:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.764087:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.764092:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764103:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764119:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764128:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764145:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788869684.764155:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869684.764160:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764168:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869684.764173:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764184:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764213:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764221:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ac0914/0x4c16c38a9b6cfc8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764237:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869684.764250:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764257:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869684.764260:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764267:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764277:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764284:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed9515b4/0x4c16c38a9b6cfc93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.764295:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869684.764297:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869684.764300:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.764688:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.765573:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.765604:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.765618:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.765622:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.765627:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.765653:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.765663:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.765671:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.765694:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869684.765763:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869684.765774:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.765784:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869684.765789:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.765801:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.765817:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.765826:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6cfc9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.765855:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.765857:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.765859:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.766326:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.766334:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766343:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.766346:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.766350:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766359:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766367:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766386:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766413:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869684.766536:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869684.766543:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.766552:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869684.766557:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.766566:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.766579:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.766605:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6cfca1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.766626:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.766628:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.766630:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.766862:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.766868:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766877:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.766880:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.766884:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766894:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766902:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766909:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.766943:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869684.766968:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869684.766973:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.766992:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869684.766996:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.767004:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.767016:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.767022:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6cfca8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.767038:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.767040:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.767042:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.768399:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.768412:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.768434:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.768438:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.768443:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.768457:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.768466:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.768473:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.768498:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869684.773321:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.773337:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.773360:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.773367:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.773374:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.773393:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.773427:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.773437:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773446:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869684.773457:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.773464:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869684.773468:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869684.773475:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773487:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773517:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773524:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfcaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773546:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869684.773549:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773556:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869684.773560:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773568:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773578:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773606:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfcb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.773621:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.773623:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.773637:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.774059:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.774499:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.774508:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.774529:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.774533:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.774538:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.774550:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.774558:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.774566:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.774612:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869684.774633:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869684.774641:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.774649:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869684.774654:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.774663:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.774676:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.774684:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfcbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.774701:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.774703:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.774705:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.775091:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.775099:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775108:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.775112:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.775116:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775126:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775134:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775141:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775163:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869684.775525:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.775531:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.775552:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.775556:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.775564:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.775578:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.775603:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6cfcc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.775623:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.775625:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.775627:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.775847:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.775854:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775861:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.775869:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.775873:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775884:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775892:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775899:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.775922:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869684.775973:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869684.775980:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.775989:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869684.775993:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.776014:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.776027:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.776034:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6cfccb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.776051:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.776053:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.776055:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.778374:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.778388:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.778405:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.778410:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.778416:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.778431:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.778440:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.778455:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.778481:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869684.779038:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.779047:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.779066:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.779071:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.779089:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.779116:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.779124:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6cfcd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.779149:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.779151:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.779154:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.779692:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.779700:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.779711:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.779715:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.779719:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.779730:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.779739:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.779746:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.779768:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869684.779915:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869684.779922:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.779943:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869684.779947:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.779955:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.779969:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.779989:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6cfcd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.780007:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.780009:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.780010:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.780335:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.780342:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.780360:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.780363:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.780367:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.780376:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.780383:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.780390:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.780408:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869684.783789:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.783807:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.783822:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.783827:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.783838:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.783861:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.783869:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6cfce0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.783923:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.783926:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.783942:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869684.784740:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869684.784751:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.784766:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=618s v=(0 0) 00010000:00010000:3.0:1788869684.784771:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869684.784777:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.784792:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.784802:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.784810:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.784831:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869684.785235:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.785242:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.785252:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.785256:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.785265:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.785280:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.785288:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfce7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.785306:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.785308:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.785310:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869684.785333:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869684.785345:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.785353:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=618s v=(0 0) 00010000:00010000:3.0:1788869684.785356:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869684.785360:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.785370:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.785379:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.785386:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.785407:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869684.787780:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869684.787796:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.787813:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=618s v=(0 0) 00010000:00010000:3.0:1788869684.787819:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869684.787825:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.787826:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.787838:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.787845:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.787883:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.787888:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.787900:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.787919:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.787927:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfcee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.787947:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869684.787959:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.787964:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.787968:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.787971:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869684.788645:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869684.790533:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869684.790548:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.790563:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869684.790568:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.790579:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.790623:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.790630:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfcf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.790656:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869684.790658:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869684.790660:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869684.795259:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869684.795275:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.795294:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1788869684.795299:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869684.795306:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.795321:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.795344:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.795351:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869684.795379:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869684.797258:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.797275:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.797289:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.797295:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.797307:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.797343:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.797351:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6cfcfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.797378:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.797379:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.797381:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869684.799576:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869684.799646:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.799689:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=618s v=(0 0) 00010000:00010000:0.0:1788869684.799695:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869684.799702:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.799720:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.799732:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.799741:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.799770:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869684.799818:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.799828:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.799840:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.799845:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.799856:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.799879:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.799887:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d510f6c4/0x4c16c38a9b6cfd03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.799922:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.799924:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.799926:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869684.800878:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869684.800889:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.800901:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=618s v=(0 0) 00010000:00010000:0.0:1788869684.800905:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869684.800910:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.800924:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.800958:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.800966:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.800984:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869684.801319:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.801326:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801335:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.801340:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801350:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801365:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801373:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c10e3874/0x4c16c38a9b6cfd0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801392:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.801394:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.801396:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869684.801713:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869684.801720:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.801729:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=618s v=(0 0) 00010000:00010000:0.0:1788869684.801732:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869684.801737:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.801745:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.801753:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.801759:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.801787:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869684.801836:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.801843:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801865:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.801868:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801877:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801889:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801896:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6cfd11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.801910:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.801912:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.801914:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869684.802663:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869684.802672:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.802682:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=618s v=(0 0) 00010000:00010000:0.0:1788869684.802685:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869684.802690:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.802700:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.802709:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.802716:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.802732:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869684.803314:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869684.803322:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.803841:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=618s v=(0 0) 00010000:00010000:0.0:1788869684.804408:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869684.804415:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.804433:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.804445:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.804452:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.804489:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788869684.805817:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869684.805830:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806265:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869684.806276:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806287:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.806292:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806305:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806333:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806341:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab23601/0x4c16c38a9b6cfd18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806359:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.806363:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806369:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.806373:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806380:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806388:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.806395:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005efe55ab/0x4c16c38a9b6cfd1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.806402:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=618s v=(0 0) 00010000:00010000:1.0:1788869684.806405:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.806408:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869684.806410:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869684.806416:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869684.806419:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.806434:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.806445:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.806459:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869684.806657:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788869684.806727:0:18606:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1788869684.806834:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17123:x1875765325147392:12345-0@lo:5:osp-pre-0-0.0 Request processed in 106641us (114395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869684.806857:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869684.806869:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da89f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17123:1875765325147392:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788869684.806903:0:17123:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788869684.807901:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da89f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17123:1875765325147520:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788869684.807978:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869684.808010:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869684.810689:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325147520 00000100:00100000:0.0:1788869684.810709:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325147520 00000100:00100000:0.0:1788869684.810781:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869684.810793:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17123:x1875765325147520:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1788869684.811489:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869684.811502:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788869684.811579:0:18605:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1788869684.812621:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869684.812627:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.812640:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.812663:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.812670:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6cfd26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869684.812703:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.812705:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869684.812708:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869684.814382:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788869684.832552:0:18601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788869684.832657:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788869684.833018:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17123:x1875765325147520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22221us (25032us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788869684.833032:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869684.833396:0:17123:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788869684.833412:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da89f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17123:1875765325147520:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788869684.833442:0:17123:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:0.0:1788869685.063887:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325147648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869685.063979:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869685.064045:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325147648 00000100:00100000:0.0:1788869685.064055:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325147648 00000100:00100000:0.0:1788869685.064121:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869685.064135:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325147648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869685.064160:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788869685.064206:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325147648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869685.064224:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869685.064280:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325147648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869685.574182:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869685.574209:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325147776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869685.574306:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869685.574503:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325147776 00000100:00100000:1.0:1788869685.574510:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325147776 00000100:00100000:1.0:1788869685.574556:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869685.574581:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325147776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869685.574635:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788869685.574693:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325147776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869685.574701:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869685.579676:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325147904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869685.579762:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869685.579812:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325147904 00000100:00100000:2.0:1788869685.579822:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325147904 00000100:00100000:0.0:1788869685.579871:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325147776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869685.579878:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869685.579890:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325147904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869685.579948:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869685.580008:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325147904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869685.580015:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788869685.580144:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325147904:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869685.840813:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869686.347394:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869686.855554:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869687.884019:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869688.902013:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788869689.229532:0:19420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788869689.229537:0:19420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788869689.229539:0:19420:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788869689.230191:0:19420:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e2840b8a000 00000020:01000004:0.0:1788869689.230215:0:19420:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788869689.230231:0:19420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788869689.230337:0:19420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e27029c99c0) 00000020:00000080:0.0:1788869689.230361:0:19420:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788869689.277006:0:19420:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788869689.287886:0:19420:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788869689.288804:0:19420:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788869689.289465:0:19420:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788869689.289869:0:19420:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788869689.291907:0:19420:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788869689.292974:0:19420:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788869689.298851:0:19420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788869689.299093:0:19420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788869689.299113:0:19420:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788869689.299128:0:19420:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4c16c38a9b6cfd34 00000020:01000004:0.0:1788869689.299136:0:19420:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788869689.299165:0:19420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788869689.299169:0:19420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788869689.299176:0:19420:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788869689.299206:0:19420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788869689.299225:0:19420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788869689.326331:0:19420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788869689.326377:0:19420:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788869689.326382:0:19420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788869689.326383:0:19420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869689.326385:0:19420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869689.326386:0:19420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869689.326388:0:19420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869689.326389:0:19420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869689.326390:0:19420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869689.326392:0:19420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869689.326393:0:19420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869689.326396:0:19420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788869689.326398:0:19420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869689.326400:0:19420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869689.326401:0:19420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869689.326402:0:19420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869689.326403:0:19420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869689.326404:0:19420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869689.326405:0:19420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869689.326406:0:19420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869689.326407:0:19420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869689.326493:0:19420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788869689.326517:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148032:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869689.326706:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869689.326769:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869689.326916:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325148032 00000100:00100000:3.0:1788869689.326926:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325148032 00000100:00100000:3.0:1788869689.327048:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788869689.327058:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:19420:x1875765325148032:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869689.327102:0:17091:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788869689.327104:0:17091:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788869689.327109:0:17091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788869689.327712:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:19420:x1875765325148032:12345-0@lo:253:mount.lustre.0 Request processed in 652us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869689.327722:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788869689.327856:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148032:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788869689.327868:0:19420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788869689.327872:0:19420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788869689.327881:0:19420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869689.327882:0:19420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869689.327884:0:19420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869689.327884:0:19420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869689.327886:0:19420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869689.327887:0:19420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869689.327888:0:19420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869689.327889:0:19420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788869689.327910:0:19420:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2840b8a000 from lustre-OST0001 10000000:01000000:1.0:1788869689.327936:0:19420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788869689.327940:0:19420:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788869689.327949:0:19420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e27025e99c0 local copy 00010000:00010000:1.0:1788869689.327960:0:19420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869689.328083:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869689.328117:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869689.328481:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869689.328672:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325148160 00000100:00100000:0.0:1788869689.328682:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325148160 00000100:00100000:0.0:1788869689.328717:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788869689.328727:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:19420:x1875765325148160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869689.328837:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:19420:x1875765325148160:12345-0@lo:501:mount.lustre.0 Request processed in 111us (718us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869689.328855:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869689.328958:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148160:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788869689.328991:0:19420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788869689.329023:0:19420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788869689.329031:0:19420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.329043:0:19420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869689.329076:0:19420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2840b8a000 10000000:01000000:1.0:1788869689.329082:0:19420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788869689.329089:0:19420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788869689.329092:0:19420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869689.329111:0:19420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788869689.329115:0:19420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788869689.329148:0:19420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.329156:0:19420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.329167:0:19420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869689.329185:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869689.329217:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869689.329253:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869689.329619:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325148288 00000100:00100000:0.0:1788869689.329625:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325148288 00000100:00100000:0.0:1788869689.329649:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788869689.329656:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:19420:x1875765325148288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869689.329667:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869689.329680:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6cfd42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfd3b expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869689.329702:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6cfd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfd3b expref: 22 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869689.329712:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6cfd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfd3b expref: 22 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869689.329719:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5200, rc 0) 00000100:00100000:0.0:1788869689.329758:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148288:12345-0@lo:101:mount.lustre.0 Request processed in 102us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869689.329764:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788869689.329933:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869689.329948:0:19420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.330115:0:19420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869689.331922:0:19420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788869689.333350:0:19420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869689.336762:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788869689.336909:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788869689.336926:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788869689.336940:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788869689.336953:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788869689.336965:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788869689.337135:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788869689.337153:0:19420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788869689.337356:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869689.337500:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869689.337634:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869689.337738:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325148416 00000100:00100000:0.0:1788869689.337747:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325148416 00000100:00100000:0.0:1788869689.337900:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788869689.337912:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869689.338396:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148416:12345-0@lo:501:mount.lustre.0 Request processed in 485us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869689.338406:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869689.338557:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869689.338683:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869689.338732:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869689.338815:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869689.338909:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325148544 00000100:00100000:2.0:1788869689.338916:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325148544 00000100:00100000:2.0:1788869689.339133:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788869689.339143:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869689.340401:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148544:12345-0@lo:503:mount.lustre.0 Request processed in 1254us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.340433:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788869689.340579:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148544:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788869689.342554:0:19420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869689.342881:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869689.342953:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869689.343106:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27025a53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869689.343208:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325148672 00000100:00100000:1.0:1788869689.343216:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325148672 00000100:00100000:1.0:1788869689.343407:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788869689.343417:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869689.344659:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148672:12345-0@lo:502:mount.lustre.0 Request processed in 1238us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869689.344671:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788869689.344801:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869689.345078:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788869689.345111:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788869689.345125:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788869689.345137:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788869689.345149:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788869689.345162:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788869689.345174:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788869689.345187:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788869689.345201:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788869689.345248:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869689.345295:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869689.345929:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27025a53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869689.346111:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325148800 00000100:00100000:3.0:1788869689.346121:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325148800 00000100:00100000:3.0:1788869689.346166:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788869689.346173:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869689.346315:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148800:12345-0@lo:502:mount.lustre.0 Request processed in 142us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869689.346323:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869689.346528:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869689.346604:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788869689.346616:0:19420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788869689.347579:0:19424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869689.347613:0:19424:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788869689.347631:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869689.347633:0:19424:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788869689.347640:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869689.347656:0:19424:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e27029cb380) 00000020:00000080:0.0:1788869689.347695:0:19424:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788869689.347702:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788869689.347803:0:19424:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2840b8a000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788869689.347812:0:19424:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788869689.347819:0:19424:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4c16c38a9b6cfd50 00010000:00010000:0.0:1788869689.355181:0:19424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788869689.358355:0:19424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788869689.362361:0:19424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788869689.365329:0:19424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788869689.365346:0:19424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869689.365355:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869689.365357:0:19424:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788869689.365361:0:19424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869689.365365:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869689.365366:0:19424:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869689.365369:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869689.365371:0:19424:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788869689.365373:0:19424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869689.365375:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869689.365376:0:19424:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788869689.365378:0:19424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869689.365380:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869689.365381:0:19424:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788869689.365385:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788869689.365648:0:19424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869689.365668:0:19424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869689.365669:0:19424:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788869689.365674:0:19424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788869689.366165:0:19420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788869689.366212:0:19420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788869689.366310:0:19420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.366325:0:19420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869689.366335:0:19420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2840b8a000 from 1 10000000:01000000:1.0:1788869689.366347:0:19420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869689.366395:0:19420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.366405:0:19420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.367143:0:19420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869689.367202:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869689.367546:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869689.367616:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869689.367905:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325148928 00000100:00100000:3.0:1788869689.367916:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325148928 00000100:00100000:3.0:1788869689.368345:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788869689.368358:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325148928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869689.368379:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869689.368398:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfd57 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.368439:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfd57 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.368451:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfd57 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.368460:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8e00, rc 0) 00000100:00100000:3.0:1788869689.368527:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325148928:12345-0@lo:101:mount.lustre.0 Request processed in 173us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869689.368534:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869689.368629:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325148928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869689.368650:0:19420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.368658:0:19420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869689.375414:0:19420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788869689.376054:0:19420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869689.376309:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788869689.376337:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788869689.376355:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788869689.376362:0:19420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788869689.376575:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869689.376717:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869689.376817:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280b02f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869689.378154:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325149056 00000100:00100000:3.0:1788869689.378168:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325149056 00000100:00100000:3.0:1788869689.378239:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869689.378253:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325149056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869689.378433:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325149056:12345-0@lo:501:mount.lustre.0 Request processed in 174us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869689.378442:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869689.378518:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869689.378576:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869689.378645:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869689.378668:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325149184 00000100:00100000:3.0:1788869689.378672:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325149184 00000100:00100000:3.0:1788869689.378690:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869689.378695:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325149184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869689.378767:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325149184:12345-0@lo:503:mount.lustre.0 Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869689.378773:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869689.378824:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869689.378836:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149184:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788869689.379735:0:19420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869689.379942:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869689.380304:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869689.380381:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702607cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869689.383184:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325149312 00000100:00100000:0.0:1788869689.383202:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325149312 00000100:00100000:0.0:1788869689.383295:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788869689.383307:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325149312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869689.383663:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325149312:12345-0@lo:502:mount.lustre.0 Request processed in 358us (3359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869689.383671:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869689.383919:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869689.384360:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788869689.384395:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788869689.384410:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788869689.384560:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788869689.384717:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788869689.384745:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788869689.384761:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788869689.384776:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788869689.384885:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788869689.384902:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788869689.384917:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788869689.385098:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869689.385167:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869689.385256:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2826812240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869689.385407:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325149440 00000100:00100000:1.0:1788869689.385415:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325149440 00000100:00100000:1.0:1788869689.385473:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788869689.385482:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325149440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869689.385625:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325149440:12345-0@lo:502:mount.lustre.0 Request processed in 144us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869689.385633:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788869689.385958:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869689.386106:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788869689.386119:0:19420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788869689.387535:0:19428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869689.387552:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869689.387554:0:19428:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788869689.387573:0:19428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2840b8a000 00000020:00000080:0.0:1788869689.387576:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869689.387712:0:19428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869689.387717:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869689.387718:0:19428:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788869689.387721:0:19428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869689.387724:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869689.387725:0:19428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788869689.387729:0:19428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2840b8a000 00000020:00000080:0.0:1788869689.387731:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869689.387926:0:19428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869689.387930:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869689.387932:0:19428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788869689.387935:0:19428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869689.387937:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869689.387939:0:19428:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869689.387942:0:19428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2840b8a000 00000020:00000080:0.0:1788869689.387944:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869689.389336:0:19428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869689.389350:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869689.389351:0:19428:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869689.389355:0:19428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869689.389358:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869689.389359:0:19428:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788869689.389363:0:19428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2840b8a000 00000020:00000080:0.0:1788869689.389365:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869689.389916:0:19428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869689.389941:0:19428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869689.389943:0:19428:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788869689.389947:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788869689.394045:0:19420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788869689.394104:0:19420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869689.394127:0:19420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.394143:0:19420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869689.394215:0:19420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788869689.394219:0:19420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2840b8a000 10000000:01000000:2.0:1788869689.394223:0:19420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2840b8a000 10000000:01000000:2.0:1788869689.394429:0:19420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869689.394438:0:19420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2840b8a000 from 1 10000000:01000000:2.0:1788869689.394442:0:19420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869689.394489:0:19420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.394499:0:19420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.394511:0:19420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869689.394555:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869689.394664:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.394705:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869689.395379:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325149568 00000100:00100000:1.0:1788869689.395392:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325149568 00000100:00100000:1.0:1788869689.395466:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788869689.395478:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+23:19420:x1875765325149568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869689.395492:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869689.395508:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7fa00/0x4c16c38a9b6cfd6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfd65 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.395536:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7fa00/0x4c16c38a9b6cfd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfd65 expref: 24 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.395562:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7fa00/0x4c16c38a9b6cfd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfd65 expref: 24 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869689.395571:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7fa00, rc 0) 00000100:00100000:1.0:1788869689.395662:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325149568:12345-0@lo:101:mount.lustre.0 Request processed in 186us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869689.395669:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869689.397007:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869689.397036:0:19420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.397050:0:19420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869689.399921:0:19420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788869689.406572:0:19420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869689.406945:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788869689.406976:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788869689.406991:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788869689.407016:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788869689.407031:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788869689.407045:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788869689.407059:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788869689.407076:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788869689.407092:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788869689.407105:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788869689.407119:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788869689.407131:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788869689.407145:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788869689.407160:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788869689.407175:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788869689.407189:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788869689.407200:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788869689.407223:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788869689.407254:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788869689.407277:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788869689.407289:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788869689.407301:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788869689.407312:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788869689.407324:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788869689.407336:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788869689.407349:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788869689.407363:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788869689.407375:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788869689.407389:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788869689.407401:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788869689.407412:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788869689.407446:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788869689.407461:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788869689.407473:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788869689.407486:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788869689.407497:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788869689.407510:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788869689.407523:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788869689.407536:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788869689.407548:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788869689.407561:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788869689.407575:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788869689.407616:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788869689.407633:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788869689.407648:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788869689.407661:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788869689.407687:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788869689.407693:0:19420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788869689.407820:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869689.407930:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.407999:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325149696 00000100:00100000:2.0:1788869689.408010:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325149696 00000100:00100000:2.0:1788869689.408081:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788869689.408091:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325149696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869689.408227:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325149696:12345-0@lo:501:mount.lustre.0 Request processed in 137us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.408235:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788869689.408286:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869689.408311:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869689.408346:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869689.408389:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.408412:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325149824 00000100:00100000:2.0:1788869689.408415:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325149824 00000100:00100000:2.0:1788869689.408437:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869689.408444:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325149824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869689.408513:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325149824:12345-0@lo:503:mount.lustre.0 Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.408519:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869689.410160:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869689.410193:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869689.414320:0:19420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869689.414460:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869689.414552:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.414628:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325149952 00000100:00100000:2.0:1788869689.414645:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325149952 00000100:00100000:2.0:1788869689.414701:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788869689.414711:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325149952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869689.414857:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325149952:12345-0@lo:502:mount.lustre.0 Request processed in 146us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.414865:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788869689.414939:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869689.414964:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325149952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869689.417748:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788869689.417811:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788869689.417827:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788869689.417854:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788869689.417873:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788869689.417888:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788869689.417904:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788869689.417916:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788869689.417929:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788869689.417941:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788869689.417954:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788869689.417967:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788869689.417981:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788869689.417996:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788869689.418050:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788869689.418069:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788869689.418082:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788869689.418097:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788869689.418110:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788869689.418123:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788869689.418137:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788869689.418151:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788869689.418177:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788869689.418193:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788869689.418206:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788869689.418219:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788869689.418248:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788869689.418263:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788869689.418277:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788869689.418291:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788869689.418319:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788869689.418336:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788869689.418348:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788869689.418359:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788869689.418372:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788869689.418383:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788869689.418395:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788869689.418408:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788869689.418419:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788869689.418432:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788869689.418447:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788869689.418461:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788869689.418476:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788869689.418490:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788869689.418505:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788869689.418519:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788869689.418545:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788869689.418561:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788869689.418651:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325150080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869689.423622:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.423703:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325150080 00000100:00100000:2.0:1788869689.423716:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325150080 00000100:00100000:2.0:1788869689.423785:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788869689.423797:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325150080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869689.424417:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325150080:12345-0@lo:502:mount.lustre.0 Request processed in 203us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.424438:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788869689.424519:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869689.424546:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325150080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869689.424882:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788869689.424910:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788869689.424950:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325150208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869689.425340:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.425383:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325150208 00000100:00100000:2.0:1788869689.425390:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325150208 00000100:00100000:2.0:1788869689.425425:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788869689.425433:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325150208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869689.425528:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325150208:12345-0@lo:502:mount.lustre.0 Request processed in 95us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.425535:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788869689.425583:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869689.432543:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325150208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869689.433514:0:19420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788869689.433535:0:19420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788869689.442864:0:19433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788869689.442886:0:19433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e28179fcd40) 00000020:00000080:1.0:1788869689.442916:0:19433:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788869689.443060:0:19433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2840b8a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869689.443065:0:19433:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2840b8a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869689.443068:0:19433:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2840b8a000 3 00010000:00080000:1.0:1788869689.443105:0:19433:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2704807800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788869689.444788:0:19433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788869689.445010:0:19433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788869689.445053:0:19433:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788869689.445068:0:19433:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4c16c38a9b6cfd7a 00000100:00080000:1.0:1788869689.445081:0:19433:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869689.445095:0:19433:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2704807800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869689.445144:0:19433:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a3b80 x1875765325150336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869689.445182:0:19433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788869689.445702:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869689.445707:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788869689.445709:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869689.445714:0:475:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 618 00000100:00080000:2.0:1788869689.445718:0:475:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788869689.445730:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e282db3e000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869689.445745:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f0bed80 x1875765325150720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869689.445773:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869689.445777:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788869689.445778:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869689.445781:0:475:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 618 00000100:00080000:2.0:1788869689.445784:0:475:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788869689.445788:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e282d8c9000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869689.445798:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f0be300 x1875765325151232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869689.445868:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325150976:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.445944:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.445990:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325151616:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446016:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.446040:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788869689.446045:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325150464:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446066:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.446082:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325151104:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446105:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.446134:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325150592:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446156:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.446173:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325151360:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446192:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.446218:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788869689.446234:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325150848:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446257:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.446274:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325151488:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446295:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.446326:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325150976 00000100:00100000:2.0:1788869689.446333:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325150976 00000100:00100000:2.0:1788869689.446372:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325150464 00000100:00100000:2.0:1788869689.446376:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325150464 00000100:00100000:2.0:1788869689.446393:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869689.446401:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325150976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446460:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325150976:12345-0@lo:400:kworker.0 Request processed in 59us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.446468:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869689.446484:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869689.446490:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325150464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446517:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325150464:12345-0@lo:400:kworker.0 Request processed in 28us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.446522:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869689.446539:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325151616 00000100:00100000:2.0:1788869689.446542:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325151616 00000100:00100000:2.0:1788869689.446572:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325151360 00000100:00100000:2.0:1788869689.446575:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325151360 00000100:00100000:2.0:1788869689.446606:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325150848 00000100:00100000:2.0:1788869689.446609:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325150848 00000100:00100000:2.0:1788869689.446627:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325151488 00000100:00100000:2.0:1788869689.446629:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325151488 00000100:00100000:2.0:1788869689.446642:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869689.446648:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325151616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446684:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325151616:12345-0@lo:400:kworker.0 Request processed in 36us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.446691:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869689.446705:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869689.446711:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325151360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446741:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325151360:12345-0@lo:400:kworker.0 Request processed in 30us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.446746:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869689.446756:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869689.446761:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325150848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446783:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325150848:12345-0@lo:400:kworker.0 Request processed in 23us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.446788:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869689.446800:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869689.446805:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325151488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446827:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325151488:12345-0@lo:400:kworker.0 Request processed in 22us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.446832:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869689.446866:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325151104 00000100:00100000:2.0:1788869689.446870:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325151104 00000100:00100000:2.0:1788869689.446896:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325150592 00000100:00100000:2.0:1788869689.446899:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325150592 00000100:00100000:2.0:1788869689.446921:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869689.446927:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325151104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.446956:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325151104:12345-0@lo:400:kworker.0 Request processed in 30us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.446972:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869689.446986:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869689.446991:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325150592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.447018:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325150592:12345-0@lo:400:kworker.0 Request processed in 28us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.447023:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788869689.447081:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282f0bca80 x1875765325150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869689.447097:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325150848:0@lo:400:kworker.0 00010000:00080000:2.0:1788869689.447108:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282f0bd880 x1875765325151488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869689.447117:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325151488:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.447127:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325150592:0@lo:400:kworker.0 00010000:00080000:2.0:1788869689.447136:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282f0bf480 x1875765325151360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869689.447144:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325151360:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.447179:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325150464:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.447187:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325151104:0@lo:400:kworker.0 00000100:00100000:2.0:1788869689.447196:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325150976:0@lo:400:kworker.0 00010000:00080000:2.0:1788869689.447206:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282f05b100 x1875765325151616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869689.447226:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325151616:0@lo:400:kworker.0 00000100:00080000:3.0:1788869689.448262:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869689.448272:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869689.448276:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:3.0:1788869689.449008:0:19433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788869689.449028:0:19433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8e27025e8000) 00000020:00000080:3.0:1788869689.449058:0:19433:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788869689.449177:0:19433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2840b8a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788869689.449181:0:19433:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2840b8a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788869689.449183:0:19433:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2840b8a000 3 00010000:00080000:3.0:1788869689.449214:0:19433:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282daf5000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.154@tcp at head 00000100:00100000:0.0:1788869689.454091:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325150336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869689.454208:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869689.455109:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325150720:0@lo:8:kworker.0 00000100:00100000:0.0:1788869689.455168:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869689.455191:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325151232:0@lo:8:kworker.0 00000100:00100000:0.0:1788869689.455211:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.455367:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325150720 00000100:00100000:2.0:1788869689.455377:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325150720 00000100:00100000:2.0:1788869689.455414:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325151232 00000100:00100000:2.0:1788869689.455417:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325151232 00000100:00100000:2.0:1788869689.455436:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869689.455443:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325150720:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788869689.455920:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869689.455927:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765325151232:12345-0@lo:8:kworker.0 00010000:00010000:3.0:1788869689.456399:0:19433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788869689.458126:0:19433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788869689.458185:0:19433:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788869689.458203:0:19433:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4c16c38a9b6cfd88 00000100:00080000:3.0:1788869689.458217:0:19433:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00100000:2.0:1788869689.458694:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325150720:12345-0@lo:8:kworker.0 Request processed in 3247us (3522us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788869689.458708:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869689.458774:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325150336 00000100:00100000:2.0:1788869689.458782:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325150336 00000100:00100000:2.0:1788869689.458814:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869689.458821:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765325150336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788869689.458865:0:17098:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 623 last 0 00000020:00000080:2.0:1788869689.458897:0:17098:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4c16c38a9b6cfd8f 00000004:00100000:2.0:1788869689.458913:0:17098:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869689.458956:0:17098:0:(import.c:65:import_set_state_nolock()) ffff8e270343c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869689.459032:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765325150336:12345-0@lo:38:llog_process_th.0 Request processed in 210us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.459040:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869689.459448:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765325151232:12345-0@lo:8:kworker.0 Request processed in 3517us (4233us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788869689.459477:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788869689.462707:0:19433:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e282daf5000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869689.463042:0:19433:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282da8b100 x1875765325151744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869689.463063:0:19433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788869689.466165:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869689.466181:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869689.466189:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788869689.466195:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325151232:0@lo:8:kworker.0 00000100:00100000:0.0:1788869689.466307:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765325151744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869689.466372:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788869689.466436:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27028a3b80 x1875765325150336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869689.466447:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869689.466456:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788869689.466466:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788869689.466473:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788869689.466477:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704807800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788869689.466484:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325150336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869689.466498:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869689.466501:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869689.466505:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788869689.466508:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325150720:0@lo:8:kworker.0 00000100:00100000:3.0:1788869689.468305:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325151744 00000100:00100000:3.0:1788869689.468322:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325151744 00000100:00100000:3.0:1788869689.468384:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869689.468392:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325151744:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788869689.468435:0:17100:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 623 last 0 00000020:00000080:3.0:1788869689.468494:0:17100:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4c16c38a9b6cfd96 00000004:00100000:3.0:1788869689.468512:0:17100:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788869689.468549:0:17100:0:(import.c:65:import_set_state_nolock()) ffff8e282daf7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869689.468662:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765325151744:12345-0@lo:38:llog_process_th.0 Request processed in 269us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869689.468669:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788869689.468871:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282da8b100 x1875765325151744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869689.468884:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869689.468899:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788869689.468907:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788869689.468913:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788869689.468916:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282daf5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788869689.468922:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765325151744:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788869689.470398:0:19433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788869689.470556:0:19420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788869689.470640:0:19420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869689.470662:0:19420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.470693:0:19420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869689.470748:0:19420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788869689.470751:0:19420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869689.470752:0:19420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869689.470753:0:19420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869689.470755:0:19420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869689.470756:0:19420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869689.470757:0:19420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869689.470760:0:19420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869689.470761:0:19420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869689.470766:0:19420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788869689.470768:0:19420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869689.470770:0:19420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869689.470771:0:19420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869689.470772:0:19420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869689.470773:0:19420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869689.470775:0:19420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869689.470776:0:19420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869689.470777:0:19420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869689.470778:0:19420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869689.470810:0:19420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788869689.470834:0:19420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325151872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788869689.470913:0:19420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.470953:0:19420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869689.471189:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325151872 00000100:00100000:3.0:1788869689.471197:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325151872 00000100:00100000:3.0:1788869689.472582:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869689.472611:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:19420:x1875765325151872:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869689.472645:0:17093:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788869689.472660:0:17093:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788869689.480409:0:17093:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869689.480432:0:17093:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788869689.480534:0:17114:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788869689.480540:0:17114:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788869689.480562:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.480582:0:17114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfc46 expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.480621:0:17114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfc54 expref: 24 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.480629:0:17114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.480671:0:17114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfc54 expref: 24 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.480696:0:17114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc54 expref: 24 pid: 17093 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869689.480711:0:17114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325152000:0@lo:104: 00000100:00100000:3.0:1788869689.480784:0:17114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869689.480847:0:17114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfc46 expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.480856:0:17114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc46 expref: 24 pid: 17092 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869689.480864:0:17114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325152128:0@lo:104: 00000100:00100000:3.0:1788869689.480884:0:17114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869689.480903:0:17114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a735000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869689.480985:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325152000 00000100:00100000:2.0:1788869689.480993:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325152000 00000100:00100000:2.0:1788869689.481067:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325152128 00000100:00100000:2.0:1788869689.481071:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325152128 00000100:00100000:2.0:1788869689.481088:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869689.481097:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+4:17114:x1875765325152000:12345-0@lo:104: 00010000:00010000:2.0:1788869689.481117:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481174:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869689.481181:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+4:17114:x1875765325152000:12345-0@lo:104: Request processed in 85us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.481190:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869689.481211:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869689.481218:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:17114:x1875765325152128:12345-0@lo:104: 00010000:00010000:2.0:1788869689.481238:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481272:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869689.481277:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+3:17114:x1875765325152128:12345-0@lo:104: Request processed in 61us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.481283:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788869689.481301:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869689.481307:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481314:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869689.481317:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481329:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869689.481337:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869689.481351:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869689.481387:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481395:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869689.481421:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481429:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6cfc54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfc5b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481445:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869689.481448:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481454:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869689.481457:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481464:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869689.481470:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869689.481475:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869689.481487:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481493:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869689.481513:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481520:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edb400/0x4c16c38a9b6cfc46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfc4d expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481534:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869689.481537:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869689.481538:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869689.481552:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325152256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869689.481607:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.481648:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325152384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869689.481671:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869689.481704:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325152256 00000100:00100000:2.0:1788869689.481708:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325152256 00010000:00010000:2.0:1788869689.481724:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc54 expref: 25 pid: 17093 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869689.481744:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325152384 00000100:00100000:2.0:1788869689.481748:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325152384 00010000:00010000:2.0:1788869689.481757:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc46 expref: 26 pid: 17092 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869689.481769:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869689.481774:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+26:3651:x1875765325152256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869689.481786:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869689.481790:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc54 expref: 26 pid: 17093 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481800:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc54 expref: 26 pid: 17093 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481824:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869689.481864:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+26:3651:x1875765325152256:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.481870:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869689.481884:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869689.481891:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+25:3648:x1875765325152384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869689.481899:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869689.481903:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc46 expref: 25 pid: 17092 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481911:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc46 expref: 25 pid: 17092 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481922:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481930:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869689.481943:0:17083:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006062804s 00010000:00010000:2.0:1788869689.481947:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481955:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481962:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481979:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481984:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869689.481988:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.481996:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.482004:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869689.482013:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869689.482040:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+25:3648:x1875765325152384:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.482047:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869689.482091:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325152384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869689.482114:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325152256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869689.482387:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869689.482409:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6cfc5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc54 expref: 24 pid: 17093 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869689.482420:0:17114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325152000:0@lo:104: 00010000:00010000:3.0:1788869689.482430:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6cfc4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfc46 expref: 23 pid: 17092 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869689.482436:0:17114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17114:1875765325152128:0@lo:104: 00010000:00010000:3.0:1788869689.482450:0:17114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.482458:0:17114:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.482477:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.482483:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6cfd9d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869689.482559:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+22:19420:x1875765325151872:12345-0@lo:253:mount.lustre.0 Request processed in 9953us (11644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869689.482567:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869689.482632:0:19420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71f22428-daa5-41c2-b06f-55c4031bf12e:19420:1875765325151872:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788869689.482644:0:19420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788869689.482647:0:19420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869689.482649:0:19420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869689.482651:0:19420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869689.482652:0:19420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869689.482653:0:19420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869689.482654:0:19420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869689.482656:0:19420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869689.482658:0:19420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869689.482659:0:19420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788869689.482673:0:19420:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788869689.490163:0:19420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788869689.498104:0:19420:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788869689.498115:0:19420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788869689.498156:0:19420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788869689.498204:0:19420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788869689.498291:0:19420:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788869689.498323:0:19420:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788869689.501434:0:19420:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869689.503546:0:19420:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869689.926758:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869690.183582:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325152512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869690.183725:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869690.183897:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325152512 00000100:00100000:1.0:1788869690.183908:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325152512 00000100:00100000:1.0:1788869690.183987:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869690.184001:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325152512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869690.184044:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788869690.184111:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325152512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869690.184118:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869690.184338:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325152512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869690.184668:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869690.184683:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325152640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869690.184722:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869690.184822:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325152640 00000100:00100000:1.0:1788869690.184838:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325152640 00000100:00100000:1.0:1788869690.184879:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869690.184887:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325152640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869690.184900:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788869690.185093:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325152640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 206us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869690.185100:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869690.185182:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325152640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869690.695214:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869690.695249:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325152768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869690.695393:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869690.695487:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325152768 00000100:00100000:1.0:1788869690.695498:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325152768 00000100:00100000:1.0:1788869690.695571:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869690.695583:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325152768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869690.695655:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869690.695728:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325152768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869690.695737:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869690.695800:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325152768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869690.697759:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869690.697790:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325152896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869690.701342:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869690.701567:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325152896 00000100:00100000:1.0:1788869690.701608:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325152896 00000100:00100000:1.0:1788869690.701700:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869690.701715:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325152896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869690.701778:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788869690.705340:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325152896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3611us (3995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869690.705363:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869690.705647:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325152896:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1788869690.936461:0:19487:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869690.937017:0:19487:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869690.953321:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869691.273321:0:17095:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869691.273332:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e282dac7800 from 10 10000000:01000000:2.0:1788869691.273340:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869691.273417:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.273443:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.273460:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869691.273500:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325153024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869691.273631:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869691.273694:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869691.279305:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325153024 00000100:00100000:2.0:1788869691.279324:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325153024 00000100:00100000:2.0:1788869691.279415:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788869691.279431:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:17095:x1875765325153024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869691.279460:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869691.279490:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d7a00/0x4c16c38a9b6cfdab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfda4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.279526:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d7a00/0x4c16c38a9b6cfdab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfda4 expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.279541:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d7a00/0x4c16c38a9b6cfdab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfda4 expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.279552:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7a00, rc 0) 00000100:00100000:2.0:1788869691.279685:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325153024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 258us (6053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869691.279692:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788869691.279777:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325153024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869691.279800:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.279826:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869691.279931:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325153152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869691.279987:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869691.280026:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869691.280277:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325153152 00000100:00100000:3.0:1788869691.280284:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325153152 00000100:00100000:3.0:1788869691.280327:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788869691.280336:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325153152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788869691.280357:0:17093:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869691.280382:0:17093:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869691.280386:0:17093:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788869691.280484:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325153152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869691.280492:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788869691.282915:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325153152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869691.283039:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869691.283051:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.283067:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869691.283080:0:17095:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869691.283083:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e280a5b7800 from 10 10000000:01000000:2.0:1788869691.283087:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869691.283137:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.283146:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.283157:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869691.291665:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325153280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869691.291772:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869691.291865:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325153280 00000100:00100000:2.0:1788869691.291877:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325153280 00000100:00100000:2.0:1788869691.291954:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788869691.291966:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325153280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869691.291992:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869691.292018:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d7200/0x4c16c38a9b6cfdb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cfdb2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.292054:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d7200/0x4c16c38a9b6cfdb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfdb2 expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.292068:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d7200/0x4c16c38a9b6cfdb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfdb2 expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.292079:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7200, rc 0) 00000100:00100000:2.0:1788869691.292121:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:17095:x1875765325153280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869691.292128:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788869691.292186:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869691.292213:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325153280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869691.292234:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.292245:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869691.292323:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325153408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869691.292358:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869691.292382:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325153408 00000100:00100000:2.0:1788869691.292386:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325153408 00000100:00100000:2.0:1788869691.292412:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788869691.292418:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:17095:x1875765325153408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869691.292433:0:17092:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869691.292453:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869691.292457:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788869691.292537:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:17095:x1875765325153408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869691.292545:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788869691.292567:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869691.292579:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325153408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869691.292680:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869691.292688:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.292698:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869691.974856:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869692.489003:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869693.002555:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.023398:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869694.793326:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869694.793332:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788869694.793336:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869694.793353:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e282db3e000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869694.793376:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a1180 x1875765325153920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869694.793436:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869694.793440:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788869694.793441:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869694.793448:0:475:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e282d8c9000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869694.793459:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27028a1880 x1875765325154432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869694.793517:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325154048:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.793611:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.793652:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325154688:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.793680:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.793707:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869694.793714:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325153536:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.793755:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.793783:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325154176:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.793807:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.793825:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325154816:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.793846:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.793872:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325153664:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.793894:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.793911:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325154304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.793930:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.793943:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325154944:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.793963:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.793989:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788869694.793994:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325153792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794014:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.794030:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325154560:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794047:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.794056:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325155072:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794075:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.794101:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325154048 00000100:00100000:1.0:1788869694.794108:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325154048 00000100:00100000:1.0:1788869694.794142:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325154688 00000100:00100000:1.0:1788869694.794145:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325154688 00000100:00100000:1.0:1788869694.794170:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325154816 00000100:00100000:1.0:1788869694.794172:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325154816 00000100:00100000:1.0:1788869694.794183:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325154944 00000100:00100000:1.0:1788869694.794185:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325154944 00000100:00100000:1.0:1788869694.794196:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325154560 00000100:00100000:1.0:1788869694.794199:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325154560 00000100:00100000:1.0:1788869694.794207:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325155072 00000100:00100000:1.0:1788869694.794209:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325155072 00000100:00100000:1.0:1788869694.794224:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869694.794231:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325154048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794282:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325154048:12345-0@lo:400:kworker.0 Request processed in 51us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794289:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869694.794305:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869694.794310:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325154688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794334:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325154688:12345-0@lo:400:kworker.0 Request processed in 24us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794339:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869694.794359:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869694.794365:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325154816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794394:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325154816:12345-0@lo:400:kworker.0 Request processed in 30us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794399:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869694.794409:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869694.794414:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325154944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794458:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325154944:12345-0@lo:400:kworker.0 Request processed in 43us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794463:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869694.794477:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869694.794482:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325154560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794506:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325154560:12345-0@lo:400:kworker.0 Request processed in 24us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794511:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869694.794521:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869694.794527:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325155072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794550:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325155072:12345-0@lo:400:kworker.0 Request processed in 23us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794555:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869694.794580:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325153536 00000100:00100000:1.0:1788869694.794584:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325153536 00000100:00100000:1.0:1788869694.794639:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788869694.794645:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325153536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794671:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325153536:12345-0@lo:400:kworker.0 Request processed in 27us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794683:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788869694.794713:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325154176 00000100:00100000:1.0:1788869694.794717:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325154176 00000100:00100000:1.0:1788869694.794749:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325153664 00000100:00100000:1.0:1788869694.794752:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325153664 00000100:00100000:1.0:1788869694.794765:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869694.794771:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325154176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794802:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325154176:12345-0@lo:400:kworker.0 Request processed in 31us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794808:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869694.794818:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869694.794823:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325153664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794847:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325153664:12345-0@lo:400:kworker.0 Request processed in 24us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794852:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869694.794875:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325154304 00000100:00100000:1.0:1788869694.794879:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325154304 00000100:00100000:1.0:1788869694.794904:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325153792 00000100:00100000:1.0:1788869694.794907:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325153792 00000100:00100000:1.0:1788869694.794927:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869694.794933:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325154304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.794963:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325154304:12345-0@lo:400:kworker.0 Request processed in 31us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.794969:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869694.794980:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869694.794985:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325153792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.795021:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325153792:12345-0@lo:400:kworker.0 Request processed in 37us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869694.795029:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788869694.795047:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869694.795051:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869694.795053:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869694.795094:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325153792:0@lo:400:kworker.0 00010000:00080000:1.0:1788869694.795108:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a0700 x1875765325154560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869694.795118:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325154560:0@lo:400:kworker.0 00010000:00080000:1.0:1788869694.795128:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c5180 x1875765325155072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869694.795136:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325155072:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.795145:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325153664:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.795153:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325154304:0@lo:400:kworker.0 00010000:00080000:1.0:1788869694.795162:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c4a80 x1875765325154944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869694.795170:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325154944:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.795211:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325153536:0@lo:400:kworker.0 00000100:00100000:1.0:1788869694.795221:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325154176:0@lo:400:kworker.0 00010000:00080000:1.0:1788869694.795230:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c7800 x1875765325154816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869694.795252:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325154816:0@lo:400:kworker.0 00010000:00080000:1.0:1788869694.795265:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a2680 x1875765325154048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869694.795272:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325154048:0@lo:400:kworker.0 00010000:00080000:1.0:1788869694.795282:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c7480 x1875765325154688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869694.795288:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325154688:0@lo:400:kworker.0 00000100:00100000:0.0:1788869694.798982:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325153920:0@lo:8:kworker.0 00000100:00100000:0.0:1788869694.799066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869694.799102:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325154432:0@lo:8:kworker.0 00000100:00100000:0.0:1788869694.799125:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869694.799297:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325153920 00000100:00100000:3.0:1788869694.799308:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325153920 00000100:00100000:3.0:1788869694.799352:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325154432 00000100:00100000:3.0:1788869694.799355:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325154432 00000100:00100000:3.0:1788869694.799377:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869694.799385:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325153920:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788869694.799424:0:18604:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:3.0:1788869694.799458:0:18604:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6cfdc0 00002000:00100000:3.0:1788869694.799473:0:18604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e282daf6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788869694.799477:0:18604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788869694.799480:0:18604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788869694.799693:0:18604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869694.799723:0:18604:0:(import.c:65:import_set_state_nolock()) ffff8e282daf2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869694.799787:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765325153920:12345-0@lo:8:kworker.0 Request processed in 401us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869694.799805:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869694.799821:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869694.799826:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325154432:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788869694.799841:0:18604:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:3.0:1788869694.799856:0:18604:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6cfdc7 00002000:00100000:3.0:1788869694.799861:0:18604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8e282daf7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788869694.799864:0:18604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788869694.799865:0:18604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788869694.799886:0:18604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788869694.799897:0:18604:0:(import.c:65:import_set_state_nolock()) ffff8e282daf4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869694.799926:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765325154432:12345-0@lo:8:kworker.0 Request processed in 99us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869694.799931:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788869694.800028:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a1180 x1875765325153920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869694.800046:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788869694.800054:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869694.800060:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788869694.800062:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869694.800083:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788869694.800089:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325153920:0@lo:8:kworker.0 00010000:00080000:0.0:1788869694.800103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a1880 x1875765325154432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869694.800113:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788869694.800117:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869694.800120:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788869694.800122:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869694.800140:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788869694.800144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325154432:0@lo:8:kworker.0 00000004:00080000:0.0:1788869694.800172:0:17124:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788869694.800257:0:17124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628713669209ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788869694.800263:0:17124:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788869694.800321:0:17842:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788869694.800340:0:17842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17842:1875765325155328:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788869694.800369:0:17842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869694.800388:0:17842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869694.800542:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869694.800553:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325155200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869694.800579:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869694.800629:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325155200 00000100:00100000:0.0:1788869694.800635:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325155200 00000100:00100000:0.0:1788869694.800673:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869694.800684:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875765325155200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869694.800701:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869694.800749:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875765325155200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869694.800755:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788869694.800787:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111d500 x1875765325155200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869694.800852:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325155200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869694.800965:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325155328 00000100:00100000:0.0:1788869694.800969:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325155328 00000100:00100000:0.0:1788869694.800998:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869694.801006:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17842:x1875765325155328:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:0.0:1788869694.801231:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788869694.801333:0:17125:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788869694.801351:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17125:1875765325155584:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788869694.801383:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869694.801398:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809e22180 going to sleep for 11 seconds 00000004:00080000:3.0:1788869694.801411:0:17841:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788869694.801476:0:17841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 628714888224ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788869694.801482:0:17841:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788869694.801637:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325155584 00000100:00100000:1.0:1788869694.801642:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325155584 00000100:00100000:1.0:1788869694.801671:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869694.801677:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17125:x1875765325155584:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788869694.804318:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325155456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869694.804422:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869694.804754:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869694.805795:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325155456 00000100:00100000:3.0:1788869694.805808:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325155456 00000100:00100000:3.0:1788869694.805864:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869694.805874:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325155456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869694.805901:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869694.805989:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325155456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869694.806006:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:3.0:1788869694.806136:0:18605:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788869694.806142:0:18605:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788869694.806183:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17842:x1875765325155328:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5177us (5812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869694.806191:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788869694.806259:0:17842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111f800 x1875765325155328/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869710 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869694.806274:0:17842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17842:1875765325155328:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788869694.806287:0:17842:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788869694.806324:0:17842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17842:1875765325155712:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788869694.806358:0:17842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869694.806388:0:17842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0d0d80 going to sleep for 11 seconds 00010000:00080000:0.0:1788869694.809686:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282da8aa00 x1875765325155456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869694.809718:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325155456:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788869694.810129:0:17078:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788869694.810529:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325155712 00000100:00100000:3.0:1788869694.810539:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325155712 00000100:00100000:3.0:1788869694.810611:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869694.810621:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17842:x1875765325155712:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788869694.810653:0:18991:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788869694.810749:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17842:x1875765325155712:12345-0@lo:5:osp-pre-1-1.0 Request processed in 129us (4390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869694.810757:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788869694.810800:0:17842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c7480 x1875765325155712/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869710 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869694.810813:0:17842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17842:1875765325155712:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788869694.810826:0:17842:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788869694.810870:0:17842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da89880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17842:1875765325155840:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788869694.810906:0:17842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869694.810929:0:17842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809e22840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869694.810943:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325155840 00000100:00100000:3.0:1788869694.810946:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325155840 00000100:00100000:3.0:1788869694.810968:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869694.810974:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17842:x1875765325155840:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788869694.811012:0:18605:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:3.0:1788869694.816836:0:18606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788869694.816850:0:18606:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788869694.816855:0:18606:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:0.0:1788869694.819093:0:17831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:3.0:1788869694.830750:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869694.830764:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830782:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1788869694.830787:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869694.830793:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830812:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830822:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830830:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830853:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869694.830867:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869694.830872:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830897:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869694.830902:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830912:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830929:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830936:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7e62835/0x4c16c38a9b6cfdce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.830956:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.830958:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.830960:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869694.833004:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869694.833020:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.833037:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1788869694.833042:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869694.833048:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.833063:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.833092:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.833101:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.833126:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869694.833908:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869694.833917:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.833928:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1788869694.833931:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869694.833936:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.833950:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.833959:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.833967:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834002:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788869694.834025:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869694.834033:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834042:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869694.834048:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834058:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834080:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834088:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdfef8c0/0x4c16c38a9b6cfdd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834105:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869694.834109:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834115:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869694.834118:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834137:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834148:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834156:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef08212d/0x4c16c38a9b6cfddc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.834169:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.834171:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.834172:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869694.835609:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869694.835620:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835635:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1788869694.835639:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869694.835644:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835656:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835665:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835680:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835702:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869694.835718:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869694.835723:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835729:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869694.835745:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835754:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835767:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835775:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c17ce6/0x4c16c38a9b6cfde3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.835792:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.835794:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.835795:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869694.837265:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869694.837287:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.837306:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1788869694.837310:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869694.837327:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.837342:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.837353:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.837361:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.837391:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869694.838846:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869694.838862:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.838905:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869694.838910:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.838921:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.838949:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.838958:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0d981bf/0x4c16c38a9b6cfdea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.838994:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.838996:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.838997:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.840990:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869694.841220:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869694.841230:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.841248:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1788869694.841253:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869694.841259:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.841277:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.841300:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.841309:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.841352:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869694.845043:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869694.845057:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.845072:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.845078:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.845089:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.845117:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.845124:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b9ac5f/0x4c16c38a9b6cfdf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.845166:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.845168:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.845170:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869694.849453:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869694.849467:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849486:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1788869694.849490:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869694.849496:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849511:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849521:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849529:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849578:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869694.849611:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869694.849618:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849627:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869694.849631:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849643:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849663:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849671:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1f14cc9/0x4c16c38a9b6cfdf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.849692:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.849693:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.849695:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869694.852927:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869694.852943:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.852962:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1788869694.852983:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869694.852991:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.853219:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.853231:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.853239:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.853263:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869694.855497:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869694.855514:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.855529:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8c00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.855534:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.855544:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.855566:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.855575:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000834a1269/0x4c16c38a9b6cfdff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.855624:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.855627:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.855629:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869694.873304:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869694.873327:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.873354:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788869694.873375:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869694.873384:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.873409:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.873422:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.873431:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.873468:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869694.875481:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869694.875499:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.875540:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.875545:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.875556:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.875584:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.875611:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c396087/0x4c16c38a9b6cfe06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.875641:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.875643:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.875646:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869694.878474:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869694.878497:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.878523:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788869694.878529:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869694.878538:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.878556:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.878569:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.878615:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.878973:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869694.879542:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869694.879559:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.879573:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ec00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.879580:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.879611:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.879664:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.879672:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001669fa1a/0x4c16c38a9b6cfe0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.879705:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.879707:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.879709:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869694.882199:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869694.882217:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.882242:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788869694.882249:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869694.882257:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.882277:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.882289:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.882299:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.882329:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869694.882400:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869694.882426:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.882448:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.882455:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.882469:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.882498:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.882506:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.882550:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.882552:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.882554:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869694.888296:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869694.888328:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.888351:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788869694.888356:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869694.888362:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.888380:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.888415:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.888424:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.888456:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869694.889073:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869694.889081:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.889092:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.889097:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.889108:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.889128:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.889136:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6cfe1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.889158:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.889159:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.889161:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869694.889519:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869694.889526:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.889536:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788869694.889540:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869694.889545:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.889555:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.889563:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.889571:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.889633:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869694.889990:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869694.889997:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.890015:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.890019:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.890027:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.890040:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.890047:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6cfe22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.890064:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.890066:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.890067:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869694.890143:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869694.890149:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.890157:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788869694.890160:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869694.890164:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.890172:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.890180:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.890186:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.893329:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869694.897182:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869694.897199:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.897218:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788869694.897237:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869694.897246:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.897263:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.897276:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.897284:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.902625:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869694.902643:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.902657:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.902662:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.902675:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.902715:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.902723:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f65dd888/0x4c16c38a9b6cfe29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.902823:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869694.902837:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.902940:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869694.902946:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.902959:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.902981:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.902993:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869694.902995:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869694.902998:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.912957:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788869694.912978:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6cfe30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.913103:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869694.917145:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869694.917168:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.917195:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788869694.917202:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869694.917211:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.917231:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.917246:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.917271:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.917302:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869694.917856:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869694.917872:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.917888:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7fe00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.917894:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.917906:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.917933:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.917941:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.917972:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.917991:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.917993:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869694.920164:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869694.920177:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.920197:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788869694.920201:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869694.920208:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.920224:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.920236:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.920244:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.920270:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869694.922094:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869694.922109:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.922123:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869694.922127:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.922138:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.922185:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.922193:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7de1652/0x4c16c38a9b6cfe3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.922235:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.922238:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.922240:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869694.927238:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869694.927257:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.927277:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788869694.927282:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869694.927290:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.927326:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.927338:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.927346:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.927373:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869694.927865:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869694.927874:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.927884:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5c00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869694.927889:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.927899:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.927919:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.927926:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6cfe45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.927967:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.927969:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.927971:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788869694.931078:0:19421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788869694.931132:0:19421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788869694.931137:0:19421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788869694.934096:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17842:x1875765325155840:12345-0@lo:5:osp-pre-1-1.0 Request processed in 123106us (123174us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788869694.934111:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869694.934321:0:17842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788869694.934332:0:17842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da89880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17842:1875765325155840:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788869694.934353:0:17842:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788869694.934427:0:17842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17842:1875765325155968:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788869694.934478:0:17842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1788869694.934492:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869694.934511:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869694.934521:0:17842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788869694.934542:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788869694.934549:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869694.934558:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.934579:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.934614:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869694.934634:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325155968 00000100:00100000:2.0:1788869694.934643:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325155968 00000100:00100000:2.0:1788869694.934694:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869694.934703:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17842:x1875765325155968:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788869694.934765:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17842:x1875765325155968:12345-0@lo:900:osp-pre-1-1.0 Request processed in 63us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869694.934772:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788869694.934806:0:17842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e284111e680 x1875765325155968/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869710 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869694.934818:0:17842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17842:1875765325155968:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788869694.935097:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.935216:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788869694.936181:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869694.936194:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.936211:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788869694.936216:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869694.936222:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.936238:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.936247:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.936254:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936473:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869694.936485:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936495:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869694.936502:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936513:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936550:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936558:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce01e06c/0x4c16c38a9b6cfe4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936607:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869694.936611:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936618:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869694.936622:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936644:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936654:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.936663:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.936664:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.936667:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869694.941048:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788869694.941071:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6cfe53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869694.942236:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869694.942251:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.942282:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788869694.942289:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869694.942298:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.942376:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.942389:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.942398:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.947182:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869694.947205:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.947250:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869694.947256:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.947271:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.947301:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.947812:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.947817:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.947821:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869694.948461:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788869694.948478:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6cfe5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.948939:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869694.952836:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869694.952867:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.952896:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788869694.952903:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869694.952911:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.952948:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.952962:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.952972:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.952999:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788869694.953987:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869694.954002:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.954018:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788869694.954080:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869694.954085:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.954101:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.954112:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.954136:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869694.954162:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869694.956286:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869694.956306:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956321:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7fe00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.956327:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956366:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956392:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956399:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082420695/0x4c16c38a9b6cfe61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956434:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869694.956438:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956445:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.956448:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956455:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956464:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956472:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000520ad1b2/0x4c16c38a9b6cfe68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.956496:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.956499:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.956501:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.956996:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869694.971474:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869694.971489:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.971507:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788869694.971511:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869694.971518:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.971534:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.971545:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.971553:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.971575:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869694.971673:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869694.971690:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.971706:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869694.971712:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869694.973186:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869694.973191:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973202:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973290:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788869694.973295:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869694.973301:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.973310:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869694.973324:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6cfe6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973327:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973354:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973363:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973384:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869694.973424:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869694.973428:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.973432:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973443:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869694.973448:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973457:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973496:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973504:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6cfe76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.973531:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.973533:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869694.973536:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869694.974007:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869694.974014:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974023:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788869694.974026:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869694.974030:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974040:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974048:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974055:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974083:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869694.974378:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869694.974384:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974393:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788869694.974396:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869694.974400:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974407:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974414:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974421:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.974444:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788869694.974484:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869694.974495:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974506:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4c00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869694.974512:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974523:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974540:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974565:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6cfe7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974620:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869694.974633:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974641:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869694.974645:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974653:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974665:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974673:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000180029c9/0x4c16c38a9b6cfe84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.974689:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.974691:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.974693:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869694.975197:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869694.980359:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869694.980374:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.980393:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788869694.980413:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869694.980420:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.980435:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.980445:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.980454:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869694.980487:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788869694.980568:0:18606:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1788869694.980692:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17125:x1875765325155584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 179010us (179303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869694.980704:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869694.980985:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17125:1875765325155584:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788869694.981019:0:17125:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788869694.981238:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17125:1875765325156096:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788869694.981312:0:17125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869694.981348:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869694.984888:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325156096 00000100:00100000:3.0:1788869694.984908:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325156096 00000100:00100000:3.0:1788869694.984989:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869694.985017:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17125:x1875765325156096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788869694.985077:0:18991:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:3.0:1788869694.985248:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869694.985259:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.985272:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869694.985277:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.985289:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.985320:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.985329:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6cfe8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869694.985374:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.985376:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869694.985378:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869694.994057:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17125:x1875765325156096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9035us (12737us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788869694.994070:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869694.998358:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17125:1875765325156096:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788869694.998389:0:17125:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1788869695.045992:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869695.310804:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869695.310845:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325156224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869695.310961:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869695.311055:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325156224 00000100:00100000:0.0:1788869695.311070:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325156224 00000100:00100000:0.0:1788869695.311179:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869695.311195:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325156224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869695.311241:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788869695.311300:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325156224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869695.311336:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869695.311404:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325156224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869695.315171:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325156352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869695.315278:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869695.315534:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325156352 00000100:00100000:1.0:1788869695.315549:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325156352 00000100:00100000:1.0:1788869695.315661:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869695.315673:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325156352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869695.315707:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788869695.315913:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325156352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869695.315924:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869695.318157:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325156352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869695.815893:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869695.815924:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325156480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869695.816032:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869695.816103:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325156480 00000100:00100000:1.0:1788869695.816117:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325156480 00000100:00100000:1.0:1788869695.816205:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869695.816219:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325156480:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869695.816538:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869695.816551:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325156608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869695.816609:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869695.816657:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325156608 00000100:00100000:2.0:1788869695.816682:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325156608 00000100:00100000:2.0:1788869695.816712:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869695.816731:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325156608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869695.816788:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869695.816869:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325156608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869695.816887:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000004:00000024:1.0:1788869695.817541:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869695.817627:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325156480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1411us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869695.817636:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788869695.818983:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325156608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869695.819913:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325156480:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788869696.069811:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869696.582491:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788869697.095092:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869698.122123:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869698.333816:0:19777:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788869699.141987:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869699.353793:0:19829:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869699.354043:0:19829:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788869699.920385:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869699.920412:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325156736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869699.920489:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869699.920566:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325156736 00000100:00100000:0.0:1788869699.920573:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325156736 00000100:00100000:0.0:1788869699.920662:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869699.920685:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325156736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869699.920716:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869699.920761:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325156736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869699.920768:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788869699.920790:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869699.920829:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325156736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869699.921197:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869699.921208:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325156864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869699.921242:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869699.921276:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325156864 00000100:00100000:3.0:1788869699.921280:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325156864 00000100:00100000:3.0:1788869699.921311:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869699.921317:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765325156864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869699.921328:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869699.921365:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765325156864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869699.921371:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788869699.921386:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869699.921404:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325156864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869699.933025:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325156992:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933104:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.933145:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325157504:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933188:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.933209:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325158016:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933233:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.933366:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869699.933376:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325157120:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933404:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.933422:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325157632:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933446:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.933463:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325158144:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933483:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.933514:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325156992 00000100:00100000:1.0:1788869699.933523:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325156992 00000100:00100000:1.0:1788869699.933570:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788869699.933578:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325156992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933661:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325156992:12345-0@lo:400:kworker.0 Request processed in 83us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.933669:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788869699.933702:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325157504 00000100:00100000:1.0:1788869699.933705:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325157504 00000100:00100000:1.0:1788869699.933728:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325157120 00000100:00100000:1.0:1788869699.933730:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325157120 00000100:00100000:1.0:1788869699.933741:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869699.933746:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325157504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933782:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325157504:12345-0@lo:400:kworker.0 Request processed in 35us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.933787:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869699.933808:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869699.933813:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325157120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933842:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325157120:12345-0@lo:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.933849:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869699.933867:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325158016 00000100:00100000:1.0:1788869699.933871:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325158016 00000100:00100000:1.0:1788869699.933903:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325158144 00000100:00100000:1.0:1788869699.933906:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325158144 00000100:00100000:1.0:1788869699.933922:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869699.933927:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325158016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933953:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325158016:12345-0@lo:400:kworker.0 Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.933959:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869699.933968:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869699.933973:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325158144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.933993:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325158144:12345-0@lo:400:kworker.0 Request processed in 20us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.933998:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869699.934015:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325157632 00000100:00100000:1.0:1788869699.934018:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325157632 00000100:00100000:1.0:1788869699.934042:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869699.934047:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325157632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.934070:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325157632:12345-0@lo:400:kworker.0 Request processed in 24us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.934076:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869699.934108:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325157120:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.934125:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325157632:0@lo:400:kworker.0 00010000:00080000:1.0:1788869699.934136:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a2680 x1875765325158144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869699.934146:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325158144:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.934154:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325156992:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.934163:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325157504:0@lo:400:kworker.0 00010000:00080000:1.0:1788869699.934173:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a1180 x1875765325158016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869699.934180:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325158016:0@lo:400:kworker.0 00000100:00080000:1.0:1788869699.934220:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869699.934225:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869699.934227:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869699.934235:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325157248:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.936470:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.936546:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325157760:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.936620:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.936649:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325158272:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.936672:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.936696:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788869699.936702:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325157376:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.936723:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.936737:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325157888:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.936774:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869699.936815:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325157248 00000100:00100000:1.0:1788869699.936822:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325157248 00000100:00100000:1.0:1788869699.936878:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869699.936887:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325157248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.936937:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325157248:12345-0@lo:400:kworker.0 Request processed in 52us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.936944:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869699.936965:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325157760 00000100:00100000:1.0:1788869699.936968:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325157760 00000100:00100000:1.0:1788869699.936983:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325158272 00000100:00100000:1.0:1788869699.936984:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325158272 00000100:00100000:1.0:1788869699.936997:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325157376 00000100:00100000:1.0:1788869699.936998:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325157376 00000100:00100000:1.0:1788869699.937007:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325157888 00000100:00100000:1.0:1788869699.937009:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325157888 00000100:00100000:1.0:1788869699.937021:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869699.937027:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325157760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.937070:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325157760:12345-0@lo:400:kworker.0 Request processed in 43us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.937076:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869699.937088:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869699.937093:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325158272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.937113:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325158272:12345-0@lo:400:kworker.0 Request processed in 21us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.937118:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869699.937127:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869699.937132:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325157376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.937161:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325157376:12345-0@lo:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.937167:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869699.937177:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869699.937182:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325157888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.937202:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325157888:12345-0@lo:400:kworker.0 Request processed in 21us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869699.937207:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788869699.937230:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869699.937234:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869699.937237:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869699.937279:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c6d80 x1875765325157376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869699.937294:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325157376:0@lo:400:kworker.0 00010000:00080000:1.0:1788869699.937305:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a1880 x1875765325157888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869699.937313:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325157888:0@lo:400:kworker.0 00000100:00100000:1.0:1788869699.937322:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325157248:0@lo:400:kworker.0 00010000:00080000:1.0:1788869699.937330:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c7480 x1875765325157760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869699.937338:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325157760:0@lo:400:kworker.0 00010000:00080000:1.0:1788869699.937346:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a2a00 x1875765325158272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869699.937353:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325158272:0@lo:400:kworker.0 00010000:00010000:2.0:1788869700.175694:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869700.421952:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325158400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869700.422046:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869700.422257:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325158400 00000100:00100000:3.0:1788869700.422270:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325158400 00000100:00100000:3.0:1788869700.422340:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869700.422350:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325158400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869700.422387:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788869700.422441:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325158400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869700.422449:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869700.422504:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325158400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869700.423703:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325158528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869700.423763:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869700.423900:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325158528 00000100:00100000:1.0:1788869700.423921:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325158528 00000100:00100000:1.0:1788869700.424000:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869700.424020:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325158528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869700.424040:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788869700.424088:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325158528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869700.424095:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869700.424154:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325158528:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1788869700.649877:0:19879:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869700.650151:0:19879:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788869700.933819:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869700.933845:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325158656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869700.933848:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325158784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869700.933958:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869700.934060:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869700.934503:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325158784 00000100:00100000:1.0:1788869700.934512:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325158784 00000100:00100000:1.0:1788869700.934563:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325158656 00000100:00100000:1.0:1788869700.934567:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325158656 00000100:00100000:1.0:1788869700.934632:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788869700.934643:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325158784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869700.934685:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869700.934715:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869700.934725:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325158656:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869700.934742:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325158784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (785us total) trans 0 rc 0/0 00000004:00000024:2.0:1788869700.934743:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788869700.934749:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869700.934791:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325158656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869700.934797:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869700.934916:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325158656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869700.935625:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325158784:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1788869700.942120:0:19421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:2.0:1788869700.967764:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869700.969158:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305135488 00000100:00100000:1.0:1788869700.969172:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305135488 00000100:00100000:1.0:1788869700.969237:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:1.0:1788869700.969245:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2406:x1875765305135488:12345-192.168.204.54@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788869700.969277:0:17092:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 56e01919-a919-418f-8d7b-865b418e1c3f@192.168.204.54@tcp t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:1.0:1788869700.969309:0:17092:0:(genops.c:1384:class_connect()) connect: client 56e01919-a919-418f-8d7b-865b418e1c3f, cookie 0x4c16c38a9b6cfe92 00000100:00080000:0.0:1788869700.973260:0:17092:0:(import.c:65:import_set_state_nolock()) ffff8e2703556000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869700.973389:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+5:2406:x1875765305135488:12345-192.168.204.54@tcp:250:mount.lustre.0 Request processed in 4137us (5629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869700.973402:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:0.0:1788869700.993334:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869700.993494:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305135616 00000100:00100000:1.0:1788869700.993506:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305135616 00000100:00100000:1.0:1788869700.993694:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:1.0:1788869700.993720:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+5:14900:x1875765305135616:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788869700.993738:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869700.993757:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7f600/0x4c16c38a9b6cfe99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca15b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869700.993786:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7f600/0x4c16c38a9b6cfe99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca15b expref: 6 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869700.993797:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7f600/0x4c16c38a9b6cfe99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca15b expref: 6 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869700.993805:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f600, rc 0) 00000100:00100000:1.0:1788869700.993873:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+6:14900:x1875765305135616:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 157us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869700.993880:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1788869701.001583:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869701.001664:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305135744 00000100:00100000:0.0:1788869701.001677:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305135744 00000100:00100000:0.0:1788869701.001760:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1788869701.001773:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+6:14900:x1875765305135744:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788869701.001909:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+6:14900:x1875765305135744:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 139us (336us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869701.001917:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:3.0:1788869701.011940:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869701.012040:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305135872 00000100:00100000:2.0:1788869701.012052:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305135872 00000100:00100000:2.0:1788869701.012108:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1788869701.012118:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+6:14900:x1875765305135872:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869701.012138:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869701.012163:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6cfea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca162 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.012194:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6cfea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca162 expref: 7 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.012205:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6cfea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca162 expref: 7 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.012214:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6600, rc 0) 00000100:00100000:2.0:1788869701.012276:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+7:14900:x1875765305135872:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 158us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.012284:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1788869701.017827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869701.018011:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305136000 00000100:00100000:1.0:1788869701.018023:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305136000 00000100:00100000:1.0:1788869701.018082:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:1.0:1788869701.018093:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+7:14900:x1875765305136000:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788869701.018472:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+8:14900:x1875765305136000:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 379us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.018481:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:3.0:1788869701.029045:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869701.029158:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305136128 00000100:00100000:0.0:1788869701.029170:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305136128 00000100:00100000:0.0:1788869701.029253:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:0.0:1788869701.029266:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+8:14900:x1875765305136128:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788869701.029431:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+8:14900:x1875765305136128:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 169us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869701.029439:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1788869701.045131:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869701.045253:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305136256 00000100:00100000:1.0:1788869701.045266:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305136256 00000100:00100000:1.0:1788869701.045389:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1788869701.045399:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+8:14919:x1875765305136256:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869701.045627:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+8:14919:x1875765305136256:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 229us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.045644:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1788869701.082115:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869701.083103:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305136384 00000100:00100000:2.0:1788869701.083117:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305136384 00000100:00100000:2.0:1788869701.083201:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:2.0:1788869701.083216:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+8:14919:x1875765305136384:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869701.083425:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+8:14919:x1875765305136384:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 212us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.083445:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:3.0:1788869701.091202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869701.091716:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305136512 00000100:00100000:1.0:1788869701.091733:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305136512 00000100:00100000:1.0:1788869701.091811:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:1.0:1788869701.091823:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+8:14919:x1875765305136512:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869701.092031:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+8:14919:x1875765305136512:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 209us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.092040:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:3.0:1788869701.102093:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869701.102209:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305136640 00000100:00100000:0.0:1788869701.102221:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305136640 00000100:00100000:0.0:1788869701.102297:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:0.0:1788869701.102310:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+8:14900:x1875765305136640:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788869701.102327:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869701.102359:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6cfea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca193 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.102405:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6cfea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca193 expref: 9 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.102417:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6cfea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca193 expref: 9 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.102427:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5a00, rc 0) 00000100:00100000:0.0:1788869701.102497:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+9:14900:x1875765305136640:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 191us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869701.102504:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:3.0:1788869701.115129:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869701.115956:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305136768 00000100:00100000:2.0:1788869701.115968:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305136768 00000100:00100000:2.0:1788869701.116049:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:2.0:1788869701.116061:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+9:14900:x1875765305136768:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788869701.116093:0:17091:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788869701.116121:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788869701.116125:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788869701.116128:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788869701.116131:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788869701.116133:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788869701.119802:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+9:14900:x1875765305136768:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 3730us (4671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.119821:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:3.0:1788869701.128377:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869701.128536:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305136896 00000100:00100000:0.0:1788869701.128548:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305136896 00000100:00100000:0.0:1788869701.128676:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:0.0:1788869701.128692:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282d8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+9:14900:x1875765305136896:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788869701.128854:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869701.128882:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca19a expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.128919:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca19a expref: 10 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.128933:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca19a expref: 10 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.128943:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5600, rc 0) 00000100:00100000:0.0:1788869701.129012:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282d8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+10:14900:x1875765305136896:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 325us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869701.129037:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:3.0:1788869701.132558:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869701.133002:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305137024 00000100:00100000:2.0:1788869701.133015:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305137024 00000100:00100000:2.0:1788869701.133143:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:2.0:1788869701.133155:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+10:14900:x1875765305137024:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869701.133362:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+10:14900:x1875765305137024:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 208us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.133370:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1788869701.139438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869701.145124:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305137152 00000100:00100000:1.0:1788869701.145145:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305137152 00000100:00100000:1.0:1788869701.145233:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:1.0:1788869701.145247:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+10:14900:x1875765305137152:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788869701.145457:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+10:14900:x1875765305137152:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 213us (6031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.145466:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:3.0:1788869701.149680:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869701.149775:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305137280 00000100:00100000:1.0:1788869701.149789:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305137280 00000100:00100000:1.0:1788869701.149866:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:1.0:1788869701.149878:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+10:14925:x1875765305137280:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869701.150052:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+10:14925:x1875765305137280:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 176us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.150060:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:3.0:1788869701.156865:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869701.157142:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305137408 00000100:00100000:0.0:1788869701.157158:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305137408 00000100:00100000:0.0:1788869701.157311:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:0.0:1788869701.157327:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+10:14925:x1875765305137408:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869701.157544:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+10:14925:x1875765305137408:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 220us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869701.157552:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:3.0:1788869701.174931:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869701.175034:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869701.175273:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305137536 00000100:00100000:2.0:1788869701.175286:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305137536 00000100:00100000:2.0:1788869701.175344:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305137792 00000100:00100000:2.0:1788869701.175347:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305137792 00000100:00100000:2.0:1788869701.175370:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788869701.175381:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1875765305137536:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788869701.175430:0:17099:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 893992aa-f001-4ff6-aa93-863511511bbf@192.168.204.54@tcp t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:2.0:1788869701.175482:0:17099:0:(genops.c:1384:class_connect()) connect: client 893992aa-f001-4ff6-aa93-863511511bbf, cookie 0x4c16c38a9b6cfeb5 00000004:00100000:2.0:1788869701.175509:0:17099:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788869701.175773:0:17099:0:(import.c:65:import_set_state_nolock()) ffff8e270343b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869701.175857:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+6:2406:x1875765305137536:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 476us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.175864:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788869701.175888:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788869701.175892:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1875765305137792:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788869701.175910:0:17099:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 893992aa-f001-4ff6-aa93-863511511bbf@192.168.204.54@tcp t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:2.0:1788869701.175945:0:17099:0:(genops.c:1384:class_connect()) connect: client 893992aa-f001-4ff6-aa93-863511511bbf, cookie 0x4c16c38a9b6cfebc 00000004:00100000:2.0:1788869701.175959:0:17099:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788869701.176090:0:17099:0:(import.c:65:import_set_state_nolock()) ffff8e270343e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869701.176116:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+6:2406:x1875765305137792:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 221us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.176122:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788869701.192684:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869701.192724:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869701.192744:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869701.192781:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305138048 00000100:00100000:3.0:1788869701.192792:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305138048 00000100:00100000:3.0:1788869701.192859:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305137664 00000100:00100000:3.0:1788869701.192863:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305137664 00000100:00100000:3.0:1788869701.192875:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305137920 00000100:00100000:3.0:1788869701.192877:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305137920 00000100:00100000:3.0:1788869701.192895:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788869701.192904:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+7:14900:x1875765305138048:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788869701.192945:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788869701.193036:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+7:14900:x1875765305138048:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 132us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.193043:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788869701.193062:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788869701.193068:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:0:x1875765305137664:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788869701.193097:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788869701.193135:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:0:x1875765305137664:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 66us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.193141:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788869701.193155:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788869701.193161:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:0:x1875765305137920:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788869701.193178:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788869701.193215:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:0:x1875765305137920:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 54us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.193220:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:0.0:1788869701.196073:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869701.196086:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788869701.196178:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869701.196562:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869701.196675:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305138176 00000100:00100000:3.0:1788869701.196687:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305138176 00000100:00100000:3.0:1788869701.196798:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869701.196810:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:14900:x1875765305138176:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788869701.196914:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:14900:x1875765305138176:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 106us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.196922:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869701.202743:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869701.202791:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869701.202875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869701.202986:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305138560 00000100:00100000:2.0:1788869701.202998:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305138560 00000100:00100000:2.0:1788869701.203064:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1788869701.203075:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:893992aa-f001-4ff6-aa93-863511511bbf+6:14900:x1875765305138560:12345-192.168.204.54@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788869701.203170:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:893992aa-f001-4ff6-aa93-863511511bbf+6:14900:x1875765305138560:12345-192.168.204.54@tcp:900:mount.lustre.0 Request processed in 97us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.203178:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788869701.203409:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305138304 00000100:00100000:1.0:1788869701.203414:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305138304 00000100:00100000:1.0:1788869701.203446:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305138432 00000100:00100000:1.0:1788869701.203450:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305138432 00000100:00100000:1.0:1788869701.203466:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788869701.203472:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1875765305138304:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788869701.203503:0:18605:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 893992aa-f001-4ff6-aa93-863511511bbf@192.168.204.54@tcp t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:1.0:1788869701.203539:0:18605:0:(genops.c:1384:class_connect()) connect: client 893992aa-f001-4ff6-aa93-863511511bbf, cookie 0x4c16c38a9b6cfec3 00002000:00100000:1.0:1788869701.203550:0:18605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 893992aa-f001-4ff6-aa93-863511511bbf/ffff8e2704805800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788869701.203561:0:18605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788869701.203776:0:18605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788869701.203808:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8e2704800800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869701.203849:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+6:2406:x1875765305138304:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 376us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.203856:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788869701.203871:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788869701.203875:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1875765305138432:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788869701.203892:0:18605:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 893992aa-f001-4ff6-aa93-863511511bbf@192.168.204.54@tcp t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:1.0:1788869701.203911:0:18605:0:(genops.c:1384:class_connect()) connect: client 893992aa-f001-4ff6-aa93-863511511bbf, cookie 0x4c16c38a9b6cfeca 00002000:00100000:1.0:1788869701.203916:0:18605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 893992aa-f001-4ff6-aa93-863511511bbf/ffff8e2704804000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788869701.203932:0:18605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788869701.204046:0:18605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788869701.204062:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8e2704805000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869701.204087:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+6:2406:x1875765305138432:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 210us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.204107:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788869701.213999:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869701.214161:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305138688 00000100:00100000:2.0:1788869701.214173:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305138688 00000100:00100000:2.0:1788869701.214458:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788869701.214471:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:14900:x1875765305138688:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788869701.217841:0:17101:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3273us 00000004:00200000:3.0:1788869701.263972:0:17101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788869701.264155:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:14900:x1875765305138688:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 49680us (50163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.264171:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788869701.495021:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869701.495157:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305138816 00000100:00100000:1.0:1788869701.495169:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305138816 00000100:00100000:1.0:1788869701.495245:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788869701.495257:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+6:14949:x1875765305138816:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:1.0:1788869701.495282:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869701.495360:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cfed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca1cb expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.495433:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fe00/0x4c16c38a9b6cfed8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.495448:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fe00/0x4c16c38a9b6cfed8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.495467:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fe00/0x4c16c38a9b6cfed8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869701.495554:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869701.495558:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869701.495666:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fe00/0x4c16c38a9b6cfed8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.495707:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e800/0x4c16c38a9b6cfed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca1cb expref: 8 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.495727:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fe00/0x4c16c38a9b6cfed8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca1cb expref: 7 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.495748:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecc900) 00010000:00010000:1.0:1788869701.495751:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869701.495755:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7fe00, rc 0) 00000100:00100000:1.0:1788869701.495829:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+7:14949:x1875765305138816:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 574us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.495836:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00010000:00010000:2.0:1788869702.214153:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869702.727962:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788869703.238073:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869703.531296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869703.532272:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305138944 00000100:00100000:3.0:1788869703.532285:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305138944 00000100:00100000:3.0:1788869703.532986:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788869703.533004:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+7:15001:x1875765305138944:12345-192.168.204.54@tcp:41:lfs.0 00000004:00000024:3.0:1788869703.533059:0:19213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788869703.533191:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+7:15001:x1875765305138944:12345-192.168.204.54@tcp:41:lfs.0 Request processed in 193us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869703.533200:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00080000:0.0:1788869703.534822:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869703.537666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.539761:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305139072 00000100:00100000:0.0:1788869703.539776:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305139072 00000100:00100000:0.0:1788869703.539938:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1788869703.539971:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+6:15001:x1875765305139072:12345-192.168.204.54@tcp:41:lfs.0 00000004:00000024:0.0:1788869703.540014:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869703.540128:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+6:15001:x1875765305139072:12345-192.168.204.54@tcp:41:lfs.0 Request processed in 181us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.540137:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00080000:1.0:1788869703.540207:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869703.546683:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869703.546810:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305139200 00000100:00100000:3.0:1788869703.546823:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305139200 00000100:00100000:3.0:1788869703.546911:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788869703.546922:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:893992aa-f001-4ff6-aa93-863511511bbf+6:15001:x1875765305139200:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:3.0:1788869703.546962:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788869703.547220:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:893992aa-f001-4ff6-aa93-863511511bbf+6:15001:x1875765305139200:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 299us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869703.547228:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00080000:1.0:1788869703.547303:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869703.552421:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.552628:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305139328 00000100:00100000:0.0:1788869703.552638:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305139328 00000100:00100000:0.0:1788869703.552708:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1788869703.552734:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703baa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:893992aa-f001-4ff6-aa93-863511511bbf+6:15001:x1875765305139328:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:0.0:1788869703.552780:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869703.552898:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703baa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:893992aa-f001-4ff6-aa93-863511511bbf+6:15001:x1875765305139328:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 181us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.552907:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00080000:1.0:1788869703.553349:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869703.793122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869703.793231:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305139456 00000100:00100000:2.0:1788869703.793242:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305139456 00000100:00100000:2.0:1788869703.793305:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:2.0:1788869703.793316:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+10:15034:x1875765305139456:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869703.793336:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869703.793357:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d7000/0x4c16c38a9b6cfedf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca1d2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.793388:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d7000/0x4c16c38a9b6cfedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca1d2 expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.793399:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d7000/0x4c16c38a9b6cfedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca1d2 expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.793408:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7000, rc 0) 00000100:00100000:2.0:1788869703.793530:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+11:15034:x1875765305139456:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 215us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.793537:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:3.0:1788869703.802469:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869703.802632:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305139584 00000100:00100000:1.0:1788869703.802644:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305139584 00000100:00100000:1.0:1788869703.802724:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:1.0:1788869703.802735:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+11:15034:x1875765305139584:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788869703.802921:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+11:15034:x1875765305139584:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 187us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869703.802930:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:3.0:1788869703.814693:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.814851:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305139712 00000100:00100000:0.0:1788869703.814862:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305139712 00000100:00100000:0.0:1788869703.814945:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:0.0:1788869703.814957:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+11:15034:x1875765305139712:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788869703.815114:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+11:15034:x1875765305139712:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 159us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.815122:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:0.0:1788869703.822788:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869703.823580:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305139840 00000100:00100000:2.0:1788869703.824069:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305139840 00000100:00100000:2.0:1788869703.824151:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:2.0:1788869703.824161:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+11:15040:x1875765305139840:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869703.824330:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+11:15040:x1875765305139840:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 171us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.824338:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:3.0:1788869703.868539:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869703.869390:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305139968 00000100:00100000:1.0:1788869703.869402:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305139968 00000100:00100000:1.0:1788869703.869462:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:1.0:1788869703.869473:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+11:15040:x1875765305139968:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869703.869715:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+11:15040:x1875765305139968:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 243us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869703.869724:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:3.0:1788869703.888896:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.889776:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305140096 00000100:00100000:0.0:1788869703.889789:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305140096 00000100:00100000:0.0:1788869703.889874:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:0.0:1788869703.889886:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+11:15040:x1875765305140096:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869703.891293:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+11:15040:x1875765305140096:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 1398us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.891306:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:3.0:1788869703.895033:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869703.895102:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305140224 00000100:00100000:2.0:1788869703.895116:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305140224 00000100:00100000:2.0:1788869703.895173:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:2.0:1788869703.895182:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283df16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+11:15034:x1875765305140224:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869703.895198:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869703.895217:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d7e00/0x4c16c38a9b6cfee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca203 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.895245:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d7e00/0x4c16c38a9b6cfee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca203 expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.895256:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d7e00/0x4c16c38a9b6cfee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca203 expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.895265:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7e00, rc 0) 00000100:00100000:2.0:1788869703.901832:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283df16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+12:15034:x1875765305140224:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 6634us (6791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.901850:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:3.0:1788869703.907345:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.907419:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305140352 00000100:00100000:0.0:1788869703.907431:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305140352 00000100:00100000:0.0:1788869703.907532:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00100000:0.0:1788869703.907543:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+12:15034:x1875765305140352:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788869703.907580:0:17092:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788869703.907625:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788869703.907629:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788869703.907637:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788869703.907640:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788869703.907642:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788869703.912766:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+12:15034:x1875765305140352:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 5213us (5419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.912797:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00100000:3.0:1788869703.916869:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869703.917155:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305140480 00000100:00100000:2.0:1788869703.917170:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305140480 00000100:00100000:2.0:1788869703.917233:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:2.0:1788869703.917244:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+12:15034:x1875765305140480:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869703.917260:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869703.917279:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca20a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.917308:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca20a expref: 13 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.917318:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca20a expref: 13 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.917327:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6e00, rc 0) 00000100:00100000:2.0:1788869703.917394:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+13:15034:x1875765305140480:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 151us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.917401:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:0.0:1788869703.919892:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869703.920066:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305140608 00000100:00100000:2.0:1788869703.920077:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305140608 00000100:00100000:2.0:1788869703.920161:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:2.0:1788869703.920172:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:15034:x1875765305140608:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869703.920342:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:15034:x1875765305140608:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 171us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.920350:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:0.0:1788869703.924663:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869703.924754:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305140736 00000100:00100000:1.0:1788869703.924783:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305140736 00000100:00100000:1.0:1788869703.924849:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:1.0:1788869703.924861:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+13:15034:x1875765305140736:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788869703.925020:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+13:15034:x1875765305140736:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 161us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869703.925028:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:3.0:1788869703.931018:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869703.931327:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305140864 00000100:00100000:1.0:1788869703.931339:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305140864 00000100:00100000:1.0:1788869703.931407:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:1.0:1788869703.931419:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+13:15045:x1875765305140864:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869703.931635:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+13:15045:x1875765305140864:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 217us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869703.931653:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:0.0:1788869703.935650:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869703.935792:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305140992 00000100:00100000:2.0:1788869703.935804:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305140992 00000100:00100000:2.0:1788869703.935859:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:2.0:1788869703.935869:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:15045:x1875765305140992:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869703.936336:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:15045:x1875765305140992:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 466us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.936345:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:0.0:1788869703.947168:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.947216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.947246:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.947280:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.947310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.947347:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305141504 00000100:00100000:0.0:1788869703.947357:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305141504 00000100:00100000:0.0:1788869703.947420:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305141632 00000100:00100000:0.0:1788869703.947423:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305141632 00000100:00100000:0.0:1788869703.947451:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788869703.947462:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:2407:x1875765305141504:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869703.947529:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:2407:x1875765305141504:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 69us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.947536:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788869703.947554:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788869703.947576:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:2407:x1875765305141632:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869703.947637:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+6:2407:x1875765305141632:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.947652:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788869703.947681:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305141248 00000100:00100000:0.0:1788869703.947685:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305141248 00000100:00100000:0.0:1788869703.947728:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305141376 00000100:00100000:0.0:1788869703.947731:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305141376 00000100:00100000:0.0:1788869703.947744:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305141120 00000100:00100000:0.0:1788869703.947746:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305141120 00000100:00100000:0.0:1788869703.947756:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:0.0:1788869703.947763:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+7:2407:x1875765305141248:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869703.947791:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+7:2407:x1875765305141248:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.947798:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:0.0:1788869703.947809:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1788869703.947817:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+6:2407:x1875765305141376:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869703.947863:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+6:2407:x1875765305141376:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 43us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.947870:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1788869703.947882:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788869703.947886:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1875765305141120:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788869703.951098:0:17099:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ddd2cdf9-4380-4081-8309-29d3c6b6c9d2@192.168.204.54@tcp t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:1.0:1788869703.951245:0:17099:0:(genops.c:1384:class_connect()) connect: client ddd2cdf9-4380-4081-8309-29d3c6b6c9d2, cookie 0x4c16c38a9b6cfef4 00000004:00100000:1.0:1788869703.951279:0:17099:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788869703.951386:0:17099:0:(import.c:65:import_set_state_nolock()) ffff8e2704801000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869703.951477:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2406:x1875765305141120:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 3586us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869703.951488:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1788869703.951864:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869703.952492:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305141888 00000100:00100000:1.0:1788869703.952501:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305141888 00000100:00100000:1.0:1788869703.952554:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:1.0:1788869703.952573:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875765305141888:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788869703.952805:0:17100:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from ddd2cdf9-4380-4081-8309-29d3c6b6c9d2@192.168.204.54@tcp t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:1.0:1788869703.952840:0:17100:0:(genops.c:1384:class_connect()) connect: client ddd2cdf9-4380-4081-8309-29d3c6b6c9d2, cookie 0x4c16c38a9b6cfefb 00000004:00100000:1.0:1788869703.952870:0:17100:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788869703.952963:0:17100:0:(import.c:65:import_set_state_nolock()) ffff8e2704803800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869703.953105:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2406:x1875765305141888:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 530us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869703.953113:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788869703.964892:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869703.965012:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305142016 00000100:00100000:0.0:1788869703.965022:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305142016 00000100:00100000:0.0:1788869703.965121:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1788869703.965134:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:0:x1875765305142016:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788869703.965177:0:19213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869703.965255:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:0:x1875765305142016:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 125us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.965263:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788869703.965706:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869703.965790:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869703.965971:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305142144 00000100:00100000:2.0:1788869703.965978:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305142144 00000100:00100000:2.0:1788869703.966025:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305141760 00000100:00100000:2.0:1788869703.966028:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305141760 00000100:00100000:2.0:1788869703.966051:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788869703.966059:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+7:15034:x1875765305142144:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788869703.966078:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869703.966120:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+7:15034:x1875765305142144:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 61us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.966127:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788869703.966156:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788869703.966163:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:0:x1875765305141760:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788869703.966174:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869703.966196:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:0:x1875765305141760:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 34us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.966202:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00080000:1.0:1788869703.966378:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869703.966383:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869703.977342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869703.977489:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305142272 00000100:00100000:2.0:1788869703.977501:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305142272 00000100:00100000:2.0:1788869703.977629:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788869703.977927:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:15034:x1875765305142272:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788869703.978044:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:15034:x1875765305142272:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 121us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869703.980675:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869703.980714:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869703.980749:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869703.980784:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305142400 00000100:00100000:3.0:1788869703.980796:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305142400 00000100:00100000:3.0:1788869703.980837:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305142528 00000100:00100000:3.0:1788869703.980840:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305142528 00000100:00100000:3.0:1788869703.980859:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788869703.980870:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875765305142400:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869703.980910:0:18606:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ddd2cdf9-4380-4081-8309-29d3c6b6c9d2@192.168.204.54@tcp t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:3.0:1788869703.980956:0:18606:0:(genops.c:1384:class_connect()) connect: client ddd2cdf9-4380-4081-8309-29d3c6b6c9d2, cookie 0x4c16c38a9b6cff02 00002000:00100000:3.0:1788869703.980970:0:18606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ddd2cdf9-4380-4081-8309-29d3c6b6c9d2/ffff8e2840b8f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869703.980982:0:18606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869703.981075:0:18606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788869703.981108:0:18606:0:(import.c:65:import_set_state_nolock()) ffff8e2840b8c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869703.981183:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2406:x1875765305142400:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 314us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869703.981191:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788869703.981209:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1788869703.981214:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875765305142528:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869703.981229:0:18606:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ddd2cdf9-4380-4081-8309-29d3c6b6c9d2@192.168.204.54@tcp t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:3.0:1788869703.981268:0:18606:0:(genops.c:1384:class_connect()) connect: client ddd2cdf9-4380-4081-8309-29d3c6b6c9d2, cookie 0x4c16c38a9b6cff09 00002000:00100000:3.0:1788869703.981278:0:18606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ddd2cdf9-4380-4081-8309-29d3c6b6c9d2/ffff8e2840b89800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869703.981284:0:18606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869703.981325:0:18606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869703.981339:0:18606:0:(import.c:65:import_set_state_nolock()) ffff8e2840b8c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869703.981363:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2406:x1875765305142528:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 148us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869703.981369:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1788869703.982382:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305142656 00000100:00100000:1.0:1788869703.982395:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305142656 00000100:00100000:1.0:1788869703.982452:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1788869703.982461:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+7:15034:x1875765305142656:12345-192.168.204.54@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788869703.982534:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+7:15034:x1875765305142656:12345-192.168.204.54@tcp:900:mount.lustre.0 Request processed in 75us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869703.982540:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788869703.985412:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1788869703.986381:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869703.986792:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305142784 00000100:00100000:3.0:1788869703.986803:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305142784 00000100:00100000:3.0:1788869703.986855:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788869703.986866:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:15034:x1875765305142784:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788869703.986954:0:17102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788869703.987040:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:15034:x1875765305142784:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 176us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869703.987048:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1788869704.204095:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869704.204313:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305142912 00000100:00100000:2.0:1788869704.204323:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305142912 00000100:00100000:2.0:1788869704.204381:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1788869704.204391:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:15069:x1875765305142912:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:2.0:1788869704.204413:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869704.204438:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cff10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca23b expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869704.204500:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869704.204513:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869704.204527:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869704.204632:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869704.204643:0:17100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869704.204667:0:17100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869704.204693:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6cff10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca23b expref: 8 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869704.204732:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca23b expref: 7 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869704.204741:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecc900) 00010000:00010000:2.0:1788869704.204744:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869704.204748:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842043400, rc 0) 00000100:00100000:2.0:1788869704.204804:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+7:15069:x1875765305142912:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 415us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869704.204810:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00010000:00010000:2.0:1788869704.261926:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869705.031795:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869705.031838:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325158912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869705.031924:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869705.032130:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325158912 00000100:00100000:0.0:1788869705.032139:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325158912 00000100:00100000:0.0:1788869705.032208:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788869705.032233:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325158912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869705.032272:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869705.032323:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325158912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.032331:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788869705.032384:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325158912:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788869705.032855:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869705.034151:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325159296:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034209:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869705.034249:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325159808:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034283:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869705.034304:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325160320:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034329:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869705.034354:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788869705.034360:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325159424:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034383:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869705.034414:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325159936:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034433:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869705.034447:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325160448:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034465:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869705.034495:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325159296 00000100:00100000:0.0:1788869705.034502:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325159296 00000100:00100000:0.0:1788869705.034563:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325159808 00000100:00100000:0.0:1788869705.034581:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325159808 00000100:00100000:0.0:1788869705.034653:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325159424 00000100:00100000:0.0:1788869705.034656:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325159424 00000100:00100000:0.0:1788869705.034689:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869705.034701:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325159296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034752:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325159296:12345-0@lo:400:kworker.0 Request processed in 54us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.034759:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869705.034776:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869705.034785:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325159808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034812:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325159808:12345-0@lo:400:kworker.0 Request processed in 30us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.034818:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869705.034831:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869705.034839:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325159424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034865:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325159424:12345-0@lo:400:kworker.0 Request processed in 29us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.034870:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869705.034891:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325160320 00000100:00100000:0.0:1788869705.034894:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325160320 00000100:00100000:0.0:1788869705.034917:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325159936 00000100:00100000:0.0:1788869705.034920:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325159936 00000100:00100000:0.0:1788869705.034934:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325160448 00000100:00100000:0.0:1788869705.034936:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325160448 00000100:00100000:0.0:1788869705.034949:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869705.034957:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325160320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.034988:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325160320:12345-0@lo:400:kworker.0 Request processed in 33us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.035004:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869705.035016:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869705.035024:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325159936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.035054:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325159936:12345-0@lo:400:kworker.0 Request processed in 32us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.035059:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869705.035070:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869705.035078:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325160448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.035105:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325160448:12345-0@lo:400:kworker.0 Request processed in 29us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.035111:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788869705.035138:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869705.035142:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869705.035144:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869705.035146:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869705.035169:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788869705.035187:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325159424:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.035201:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325159936:0@lo:400:kworker.0 00010000:00080000:0.0:1788869705.035213:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283b470a80 x1875765325160448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869705.035224:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325160448:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.035234:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325159296:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.035242:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325159808:0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.035281:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325160320:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.035824:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325159040:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.035877:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869705.035920:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325159552:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.035945:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869705.035969:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325160064:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.035991:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869705.036023:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325160576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869705.036053:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869705.036073:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869705.036078:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325159168:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.036102:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869705.036140:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325159680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.036162:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869705.036182:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325160192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.036204:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869705.036229:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325159552 00000100:00100000:1.0:1788869705.036236:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325159552 00000100:00100000:2.0:1788869705.036361:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325159040 00000100:00100000:2.0:1788869705.036366:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325159040 00000100:00100000:2.0:1788869705.036401:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788869705.036413:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325159040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869705.036460:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325159040:12345-0@lo:400:kworker.0 Request processed in 53us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869705.036468:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788869705.036967:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325160064 00000100:00100000:1.0:1788869705.036974:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325160064 00000100:00100000:3.0:1788869705.037085:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325160192 00000100:00100000:3.0:1788869705.037090:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325160192 00000100:00100000:0.0:1788869705.037158:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869705.037178:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325159552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869705.037224:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325159552:12345-0@lo:400:kworker.0 Request processed in 59us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.037230:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869705.037249:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325160576 00000100:00100000:0.0:1788869705.037253:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325160576 00000100:00100000:0.0:1788869705.037293:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869705.037301:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325160576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869705.037316:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869705.037348:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325160576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.037355:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869705.037433:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869705.037440:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325160064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.037469:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325160064:12345-0@lo:400:kworker.0 Request processed in 31us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869705.037475:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869705.037493:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325159168 00000100:00100000:1.0:1788869705.037496:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325159168 00000100:00100000:1.0:1788869705.037515:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325159680 00000100:00100000:1.0:1788869705.037517:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325159680 00000100:00100000:1.0:1788869705.037528:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788869705.037533:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325159168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.037579:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325159168:12345-0@lo:400:kworker.0 Request processed in 45us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869705.037604:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788869705.037640:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869705.037646:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325159680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.037676:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325159680:12345-0@lo:400:kworker.0 Request processed in 31us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869705.037692:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869705.037743:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325159168:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.037754:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325159680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.037763:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325159040:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.037773:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325159552:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.037782:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325160064:0@lo:400:kworker.0 00000100:00100000:1.0:1788869705.037797:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325160576:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788869705.039073:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869705.039083:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869705.043657:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788869705.043675:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325160192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869705.043824:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325160192:12345-0@lo:400:kworker.0 Request processed in 155us (7618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869705.043833:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788869705.044449:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e283b473800 x1875765325160192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869705.044466:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325160192:0@lo:400:kworker.0 00010000:00010000:3.0:1788869705.285971:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869705.541914:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869705.549685:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325160832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869705.549806:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869705.550068:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325160832 00000100:00100000:0.0:1788869705.550083:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325160832 00000100:00100000:0.0:1788869705.550189:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869705.550203:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325160832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869705.552854:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788869705.553007:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325160832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2803us (3195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.553020:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869705.553207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325160832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869705.553469:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325160704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869705.553522:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869705.554392:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325160704 00000100:00100000:0.0:1788869705.554404:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325160704 00000100:00100000:0.0:1788869705.554520:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869705.554545:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325160704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869705.554579:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788869705.554692:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325160704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869705.554701:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869705.554783:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325160704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869706.054698:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869706.054723:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325160960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869706.054803:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.055107:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325160960 00000100:00100000:1.0:1788869706.055118:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325160960 00000100:00100000:1.0:1788869706.055176:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869706.055186:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325160960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869706.055224:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788869706.055283:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325160960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869706.055290:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869706.055476:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325160960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869706.057474:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325161088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869706.057563:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.057945:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325161088 00000100:00100000:1.0:1788869706.057956:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325161088 00000100:00100000:1.0:1788869706.058062:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869706.058072:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325161088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869706.058108:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869706.058168:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325161088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869706.058176:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788869706.058238:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325161088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788869706.311623:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869706.824763:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1788869707.081821:0:19421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00100000:3.0:1788869707.081834:0:19421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 893992aa-f001-4ff6-aa93-863511511bbf 00000001:00100000:2.0:1788869707.082606:0:17831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00100000:2.0:1788869707.082617:0:17831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 893992aa-f001-4ff6-aa93-863511511bbf 00000001:00100000:3.0:1788869707.083236:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00100000:3.0:1788869707.083245:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 893992aa-f001-4ff6-aa93-863511511bbf 00000001:00100000:3.0:1788869707.085006:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00100000:3.0:1788869707.085017:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 893992aa-f001-4ff6-aa93-863511511bbf 00010000:00010000:3.0:1788869707.344046:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869707.472135:0:19977:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788869708.357905:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869709.242943:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869709.242985:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869709.243006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869709.243026:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869709.245913:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869709.245955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869709.245979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869709.246001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869709.246029:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869709.246080:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305143424 00000100:00100000:3.0:1788869709.246092:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305143424 00000100:00100000:3.0:1788869709.246153:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305143936 00000100:00100000:3.0:1788869709.246156:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305143936 00000100:00100000:3.0:1788869709.246171:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305143552 00000100:00100000:3.0:1788869709.246173:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305143552 00000100:00100000:3.0:1788869709.246201:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305144064 00000100:00100000:3.0:1788869709.246204:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305144064 00000100:00100000:3.0:1788869709.246231:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869709.246242:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+5:2410:x1875765305143424:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869709.246327:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+5:2410:x1875765305143424:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 87us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869709.246335:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869709.246355:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788869709.246362:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2410:x1875765305143936:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869709.246386:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2410:x1875765305143936:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (3359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869709.246392:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788869709.246404:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788869709.246410:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+5:2410:x1875765305143552:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869709.246433:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+5:2410:x1875765305143552:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869709.246439:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788869709.246449:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1788869709.246465:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2410:x1875765305144064:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869709.249195:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305143168 00000100:00100000:1.0:1788869709.249212:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305143168 00000100:00100000:1.0:1788869709.249420:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305143680 00000100:00100000:1.0:1788869709.249425:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305143680 00000100:00100000:1.0:1788869709.249441:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305143296 00000100:00100000:1.0:1788869709.249444:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305143296 00000100:00100000:1.0:1788869709.249468:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305143808 00000100:00100000:1.0:1788869709.249471:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305143808 00000100:00100000:1.0:1788869709.249516:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788869709.249527:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+6:2410:x1875765305143168:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869709.249710:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+6:2410:x1875765305143168:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 184us (6777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869709.249718:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788869709.249739:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1788869709.249745:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2410:x1875765305143680:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869709.249768:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2410:x1875765305143680:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (6762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869709.249773:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1788869709.249783:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1788869709.249801:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:2410:x1875765305143296:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869709.249826:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:2410:x1875765305143296:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (3870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869709.249832:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1788869709.249844:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1788869709.249850:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2410:x1875765305143808:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869709.249867:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2410:x1875765305143808:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 18us (3866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869709.249873:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1788869709.250676:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2410:x1875765305144064:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 4215us (4641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869709.250685:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1788869709.250725:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305143040 00000100:00100000:3.0:1788869709.250731:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305143040 00000100:00100000:3.0:1788869709.250766:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:3.0:1788869709.250773:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:2410:x1875765305143040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869709.250798:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:2410:x1875765305143040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869709.250812:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00080000:3.0:1788869709.250855:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869709.250859:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869709.250863:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869709.250866:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869709.381756:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869710.151150:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325161216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869710.151246:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869710.151332:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325161216 00000100:00100000:2.0:1788869710.151340:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325161216 00000100:00100000:2.0:1788869710.151405:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869710.151415:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325161216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869710.151456:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869710.151505:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325161216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869710.151512:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788869710.151974:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869710.151988:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325161600:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.152090:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869710.152116:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325162112:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.152139:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869710.152159:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325162624:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.152186:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869710.152702:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325161472:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.152740:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869710.152775:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325161984:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.152796:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869710.152813:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325162496:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.152836:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869710.152860:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788869710.152866:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325161344:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.152895:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869710.152918:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325161856:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.152941:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869710.152959:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325162368:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.152981:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869710.153064:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325161472 00000100:00100000:0.0:1788869710.153072:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325161472 00000100:00100000:0.0:1788869710.153131:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325161856 00000100:00100000:0.0:1788869710.153134:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325161856 00000100:00100000:0.0:1788869710.153155:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788869710.153165:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325161472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.153229:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325161472:12345-0@lo:400:kworker.0 Request processed in 65us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869710.153246:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788869710.153263:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869710.153273:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325161856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.153303:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325161856:12345-0@lo:400:kworker.0 Request processed in 34us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869710.153310:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869710.153329:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325161600 00000100:00100000:0.0:1788869710.153333:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325161600 00000100:00100000:0.0:1788869710.153372:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325162112 00000100:00100000:0.0:1788869710.153376:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325162112 00000100:00100000:0.0:1788869710.153392:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325161984 00000100:00100000:0.0:1788869710.153395:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325161984 00000100:00100000:0.0:1788869710.153409:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869710.153416:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325161600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.153459:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325161600:12345-0@lo:400:kworker.0 Request processed in 44us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869710.153466:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869710.153477:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869710.153485:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325162112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.153533:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325162112:12345-0@lo:400:kworker.0 Request processed in 49us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869710.153539:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869710.153812:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325161600:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.153825:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325162112:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.153842:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869710.153850:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325161728:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.153878:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869710.153903:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325162240:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.153924:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869710.153935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325162752:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.153955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869710.153977:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869710.153986:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325161984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.154028:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325161984:12345-0@lo:400:kworker.0 Request processed in 32us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869710.154034:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869710.154055:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325162624 00000100:00100000:2.0:1788869710.154059:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325162624 00000100:00100000:2.0:1788869710.154082:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325162496 00000100:00100000:2.0:1788869710.154085:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325162496 00000100:00100000:2.0:1788869710.154096:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325162368 00000100:00100000:2.0:1788869710.154098:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325162368 00000100:00100000:2.0:1788869710.154127:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325161728 00000100:00100000:2.0:1788869710.154130:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325161728 00000100:00100000:2.0:1788869710.154139:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325162240 00000100:00100000:2.0:1788869710.154141:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325162240 00000100:00100000:2.0:1788869710.154151:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325162752 00000100:00100000:2.0:1788869710.154153:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325162752 00000100:00100000:2.0:1788869710.154168:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869710.154174:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325162624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869710.154312:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869710.154322:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325162496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869710.154360:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325162496:12345-0@lo:400:kworker.0 Request processed in 41us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869710.154366:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869710.154379:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869710.154385:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325162368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869710.154411:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325162368:12345-0@lo:400:kworker.0 Request processed in 27us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869710.154417:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869710.154428:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869710.154433:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325161728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869710.154476:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325161728:12345-0@lo:400:kworker.0 Request processed in 43us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869710.154482:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869710.154503:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869710.154508:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325162240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869710.154536:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325162240:12345-0@lo:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869710.154541:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869710.154566:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869710.154573:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325162752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869710.154623:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325162752:12345-0@lo:400:kworker.0 Request processed in 50us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869710.154629:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869710.156390:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325161344 00000100:00100000:0.0:1788869710.156409:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325161344 00000100:00100000:0.0:1788869710.156502:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788869710.156515:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3651:x1875765325161344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.156648:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3651:x1875765325161344:12345-0@lo:400:kworker.0 Request processed in 136us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869710.156656:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788869710.156713:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325161344:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.156729:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325161856:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.156740:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325162368:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.156751:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325161472:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.156762:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325161984:0@lo:400:kworker.0 00010000:00080000:0.0:1788869710.156777:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a33b80 x1875765325162496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869710.156788:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325162496:0@lo:400:kworker.0 00000100:00100000:0.0:1788869710.156819:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869710.156831:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325162880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869710.156865:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869710.156905:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869710.156911:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869710.156914:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869710.156917:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869710.156935:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325162880 00000100:00100000:0.0:1788869710.156939:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325162880 00000100:00100000:0.0:1788869710.156969:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869710.156977:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325162880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869710.156993:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869710.157029:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325162880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869710.157044:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869710.157079:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325162880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869710.157310:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325162624:12345-0@lo:400:kworker.0 Request processed in 3134us (5121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869710.157319:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869710.157360:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325161216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869710.157391:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325161728:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.157403:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325162240:0@lo:400:kworker.0 00010000:00080000:2.0:1788869710.157416:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a31f80 x1875765325162752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869710.157424:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325162752:0@lo:400:kworker.0 00000100:00100000:2.0:1788869710.157435:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325162624:0@lo:400:kworker.0 00010000:00010000:2.0:1788869710.405906:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869710.661955:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325163008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869710.662042:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869710.662099:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325163008 00000100:00100000:2.0:1788869710.662257:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325163008 00000100:00100000:2.0:1788869710.662367:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869710.662378:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325163008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869710.662413:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788869710.662476:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325163008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869710.662484:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869710.662633:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283f47c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325163136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869710.662665:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869710.662919:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325163136 00000100:00100000:3.0:1788869710.662926:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325163136 00000100:00100000:3.0:1788869710.662953:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869710.662960:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325163136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869710.662972:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788869710.663062:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325163136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869710.663069:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869710.663293:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325163008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869710.663467:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283f47c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325163136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869711.173872:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325163264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869711.173958:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869711.173997:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325163392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869711.174021:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869711.174068:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325163264 00000100:00100000:2.0:1788869711.174077:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325163264 00000100:00100000:2.0:1788869711.174124:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325163392 00000100:00100000:2.0:1788869711.174127:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325163392 00000100:00100000:2.0:1788869711.174144:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788869711.174152:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325163264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869711.174190:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869711.174244:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325163264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869711.174252:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788869711.174271:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788869711.174277:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325163392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869711.174294:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869711.174323:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325163392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869711.174328:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788869711.174371:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325163264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869711.174383:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325163392:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788869711.329552:0:20125:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc06905c0 20000000:00000080:1.0:1788869711.330155:0:20125:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e283b078000 uarg=0000000000000000 20000000:01000000:1.0:1788869711.330205:0:20125:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788869711.330211:0:20125:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788869711.330216:0:20125:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788869711.331112:0:20126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788869711.331313:0:20125:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788869711.341386:0:20125:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788869711.341434:0:20125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341455:0:20125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbac expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341464:0:20125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbba expref: 23 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341471:0:20125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbf9 expref: 23 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341501:0:20125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cfd57 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341511:0:20125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca19a expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341518:0:20125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca20a expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341526:0:20125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341632:0:20125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca20a expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341652:0:20125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca20a expref: 12 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.341671:0:20125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325163520:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869711.341784:0:20125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca19a expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.341794:0:20125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca19a expref: 12 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.343288:0:20125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325163648:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869711.343410:0:20125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfd57 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.343456:0:20125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfd57 expref: 23 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.343467:0:20125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325163776:0@lo:104: 00000100:00100000:1.0:1788869711.343509:0:20125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869711.343551:0:20125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfbf9 expref: 23 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.343560:0:20125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbf9 expref: 23 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.343568:0:20125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325163904:0@lo:104: 00000100:00100000:1.0:1788869711.343612:0:20125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869711.343638:0:20125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfbba expref: 23 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.343647:0:20125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbba expref: 23 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.343654:0:20125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325164032:0@lo:104: 00000100:00100000:1.0:1788869711.343673:0:20125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869711.343687:0:20125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6cfbac expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869711.343694:0:20125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbac expref: 23 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.343701:0:20125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325164160:0@lo:104: 00000100:00100000:1.0:1788869711.343730:0:20125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869711.343741:0:20125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869711.347938:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325163776 00000100:00100000:3.0:1788869711.347956:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325163776 00000100:00100000:3.0:1788869711.348020:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325163904 00000100:00100000:3.0:1788869711.348024:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325163904 00000100:00100000:3.0:1788869711.348035:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325164032 00000100:00100000:3.0:1788869711.348038:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325164032 00000100:00100000:3.0:1788869711.348046:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325164160 00000100:00100000:3.0:1788869711.348049:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325164160 00000100:00100000:3.0:1788869711.348068:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869711.348079:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+6:20125:x1875765325163776:12345-0@lo:104: 00010000:00010000:3.0:1788869711.348101:0:17082:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348207:0:17082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869711.348229:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+6:20125:x1875765325163776:12345-0@lo:104: Request processed in 153us (4719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.348236:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869711.348255:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869711.348261:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+5:20125:x1875765325163904:12345-0@lo:104: 00010000:00010000:3.0:1788869711.348271:0:17082:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348309:0:17082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869711.348315:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+5:20125:x1875765325163904:12345-0@lo:104: Request processed in 54us (4703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.348321:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869711.348332:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869711.348337:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+4:20125:x1875765325164032:12345-0@lo:104: 00010000:00010000:3.0:1788869711.348345:0:17082:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348372:0:17082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788869711.348378:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+4:20125:x1875765325164032:12345-0@lo:104: Request processed in 41us (4703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.348383:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869711.348395:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869711.348400:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+3:20125:x1875765325164160:12345-0@lo:104: 00010000:00010000:3.0:1788869711.348407:0:17082:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348444:0:17082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788869711.348454:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71f22428-daa5-41c2-b06f-55c4031bf12e+3:20125:x1875765325164160:12345-0@lo:104: Request processed in 54us (4723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.348460:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788869711.348479:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788869711.348486:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348495:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f800 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869711.348499:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348509:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869711.348517:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869711.348523:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869711.348565:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348573:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869711.348626:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348634:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f800/0x4c16c38a9b6cfd57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfd5e expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348651:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869711.348654:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348670:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869711.348673:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348680:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869711.348687:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869711.348692:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869711.348708:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348714:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869711.348721:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348726:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cfbf9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfc00 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348738:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869711.348741:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348746:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869711.348749:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348766:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869711.348774:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869711.348780:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869711.348794:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348800:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869711.348816:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348823:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edae00/0x4c16c38a9b6cfbba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfbc1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348834:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869711.348837:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348842:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869711.348845:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348852:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869711.348858:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869711.348868:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869711.348882:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348888:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869711.348894:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348899:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4000/0x4c16c38a9b6cfbac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6cfbb3 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.348913:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869711.348914:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869711.348916:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869711.348923:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869711.348938:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325164288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869711.348982:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869711.349016:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869711.349022:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325164416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869711.349042:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869711.349073:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325164544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869711.349096:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869711.349115:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869711.349120:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325164672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869711.349138:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869711.349166:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325164288 00000100:00100000:3.0:1788869711.349172:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325164288 00010000:00010000:3.0:1788869711.349202:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfd57 expref: 24 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869711.349217:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325164416 00000100:00100000:3.0:1788869711.349219:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325164416 00010000:00010000:3.0:1788869711.349229:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbf9 expref: 25 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869711.349237:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325164544 00000100:00100000:3.0:1788869711.349240:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325164544 00010000:00010000:3.0:1788869711.349249:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbba expref: 26 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869711.349258:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325164672 00000100:00100000:3.0:1788869711.349261:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325164672 00010000:00010000:3.0:1788869711.349270:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbac expref: 27 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869711.349282:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869711.349287:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+27:3650:x1875765325164288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869711.349298:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869711.349303:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfd57 expref: 27 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.349311:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfd57 expref: 27 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.349326:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869711.349356:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+27:3650:x1875765325164288:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.349362:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869711.349382:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869711.349387:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+26:3650:x1875765325164416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869711.349394:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869711.349399:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbf9 expref: 26 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.349407:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbf9 expref: 26 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.349429:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869711.349451:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+26:3650:x1875765325164416:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.349457:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869711.349469:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869711.349474:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+25:3648:x1875765325164544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869711.349481:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869711.349485:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbba expref: 25 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.349493:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbba expref: 25 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.349502:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869711.349526:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+25:3648:x1875765325164544:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.349532:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869711.349543:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869711.349549:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325164672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869711.349563:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869711.349568:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbac expref: 24 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.349576:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbac expref: 24 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.349612:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869711.349634:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325164672:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.349640:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869711.349695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325164672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869711.349703:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325164544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869711.349731:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325164416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869711.349738:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325164288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869711.351038:0:20125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed8e00/0x4c16c38a9b6cfd5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfd57 expref: 23 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.351059:0:20125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325163776:0@lo:104: 00010000:00010000:1.0:1788869711.351074:0:20125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed9e00/0x4c16c38a9b6cfc00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbf9 expref: 22 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.351082:0:20125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325163904:0@lo:104: 00010000:00010000:1.0:1788869711.351092:0:20125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed9c00/0x4c16c38a9b6cfbc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbba expref: 21 pid: 17093 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.351100:0:20125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325164032:0@lo:104: 00010000:00010000:1.0:1788869711.351110:0:20125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6cfbb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6cfbac expref: 20 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869711.351118:0:20125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325164160:0@lo:104: 00000100:00100000:1.0:1788869711.358467:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869711.358607:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305144192 00000100:00100000:3.0:1788869711.358618:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305144192 00000100:00100000:0.0:1788869711.358862:0:20125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325163520:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869711.362911:0:20125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20125:1875765325163648:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869711.362965:0:20125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.363226:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca20a expref: 13 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869711.363519:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788869711.363535:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27025f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56e01919-a919-418f-8d7b-865b418e1c3f+13:2410:x1875765305144192:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869711.363554:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869711.363561:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca20a expref: 13 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869711.363615:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca20a expref: 13 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869711.363636:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6cfeed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca20a expref: 13 pid: 17091 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869711.363651:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869711.363976:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27025f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56e01919-a919-418f-8d7b-865b418e1c3f+12:2410:x1875765305144192:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 445us (5520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869711.363985:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788869711.364698:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869711.365273:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305144320 00000100:00100000:3.0:1788869711.365283:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305144320 00010000:00010000:3.0:1788869711.365324:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca19a expref: 12 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869711.365421:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788869711.365431:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56e01919-a919-418f-8d7b-865b418e1c3f+12:2410:x1875765305144320:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869711.365460:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869711.365466:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca19a expref: 12 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.365481:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca19a expref: 12 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.365498:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5600/0x4c16c38a9b6cfeae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca19a expref: 12 pid: 17092 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.365515:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.365524:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.365542:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.365549:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.365555:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.365562:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.365568:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7ec00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869711.366096:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.366124:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.366137:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.366149:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869711.366257:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56e01919-a919-418f-8d7b-865b418e1c3f+11:2410:x1875765305144320:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 826us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.366265:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:0.0:1788869711.366411:0:20125:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869711.366430:0:20125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869711.366436:0:20125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff1e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869711.434779:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869712.454785:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869712.902735:0:17095:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869712.902746:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2840b8a000 from 13 10000000:01000000:2.0:1788869712.902752:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869712.902811:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869712.902825:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869712.902837:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869712.902866:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325164800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869712.902952:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869712.903003:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869712.903059:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325164800 00000100:00100000:1.0:1788869712.903066:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325164800 00000100:00100000:1.0:1788869712.903122:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788869712.903131:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+20:17095:x1875765325164800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869712.903144:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869712.903157:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cff2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cff25 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.903177:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cff2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cff25 expref: 21 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.903202:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cff2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cff25 expref: 21 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.903211:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e800, rc 0) 00000100:00100000:1.0:1788869712.903258:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+21:17095:x1875765325164800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869712.903265:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788869712.903313:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325164800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869712.903329:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.903338:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869712.903415:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325164928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.903438:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.903451:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869712.903464:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325164928 00000100:00100000:1.0:1788869712.903467:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325164928 00000100:00100000:1.0:1788869712.903487:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788869712.903493:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:17095:x1875765325164928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.903634:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:17095:x1875765325164928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869712.903641:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788869712.903667:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325164928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.903705:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.903736:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.903746:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869712.903755:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325165056 00000100:00100000:1.0:1788869712.903758:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325165056 00000100:00100000:1.0:1788869712.903774:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788869712.903779:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:17095:x1875765325165056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.903841:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:17095:x1875765325165056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869712.903847:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788869712.903880:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788869712.904785:0:20181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788869712.905248:0:17095:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788869712.905270:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869712.905279:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.905290:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869712.905301:0:17095:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869712.905304:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2817531000 from 13 10000000:01000000:1.0:1788869712.905306:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869712.905336:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.905343:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.905367:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869712.905398:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.905448:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.905485:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869712.905542:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325165184 00000100:00100000:2.0:1788869712.905548:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325165184 00000100:00100000:2.0:1788869712.905603:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788869712.905616:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+21:17095:x1875765325165184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869712.905628:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869712.905638:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6cff3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cff33 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869712.905657:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6cff3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cff33 expref: 22 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869712.905666:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6cff3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cff33 expref: 22 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869712.905674:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842043e00, rc 0) 00000100:00100000:2.0:1788869712.905703:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:17095:x1875765325165184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869712.905709:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788869712.905774:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869712.905786:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.905794:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869712.905837:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.905858:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.905881:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869712.905997:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325165312 00000100:00100000:2.0:1788869712.906001:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325165312 00000100:00100000:2.0:1788869712.906028:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788869712.906034:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+22:17095:x1875765325165312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869712.906130:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+22:17095:x1875765325165312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869712.906137:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788869712.906198:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.906222:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.906256:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.906275:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869712.906320:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325165440 00000100:00100000:2.0:1788869712.906324:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325165440 00000100:00100000:2.0:1788869712.906354:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788869712.906361:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+22:17095:x1875765325165440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869712.906448:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+22:17095:x1875765325165440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869712.906460:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788869712.907074:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869712.912027:0:20182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788869712.912837:0:17095:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788869712.912865:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869712.912879:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.912921:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869712.912935:0:17095:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869712.912939:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282dac7800 from 13 10000000:01000000:1.0:1788869712.912942:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869712.912989:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.912998:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.913011:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869712.913042:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.913120:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.913168:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869712.913196:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325165568 00000100:00100000:1.0:1788869712.913204:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325165568 00000100:00100000:1.0:1788869712.913252:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788869712.913262:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+22:17095:x1875765325165568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869712.913276:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869712.913290:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6cff48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cff41 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.913315:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6cff48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cff41 expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.913336:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6cff48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cff41 expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.913345:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7f800, rc 0) 00000100:00100000:1.0:1788869712.913379:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325165568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869712.913397:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788869712.913446:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869712.913461:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.913471:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869712.913524:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.913547:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.913560:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869712.913573:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325165696 00000100:00100000:1.0:1788869712.913576:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325165696 00000100:00100000:1.0:1788869712.913614:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788869712.913621:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325165696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.913721:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325165696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869712.913729:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788869712.913756:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.913789:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.913827:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.913840:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869712.913851:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325165824 00000100:00100000:1.0:1788869712.913854:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325165824 00000100:00100000:1.0:1788869712.913872:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788869712.913876:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325165824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.913942:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325165824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869712.913949:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788869712.913984:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788869712.914641:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788869712.914694:0:17095:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788869712.914708:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869712.914715:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.914722:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869712.914733:0:17095:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869712.914735:0:17095:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e280a5b7800 from 13 10000000:01000000:1.0:1788869712.914738:0:17095:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869712.914763:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.914771:0:17095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.914787:0:17095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869712.914803:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.914836:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.914855:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869712.914872:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325165952 00000100:00100000:1.0:1788869712.914877:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325165952 00000100:00100000:1.0:1788869712.914904:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788869712.914911:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+23:17095:x1875765325165952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869712.914920:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869712.914929:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7e400/0x4c16c38a9b6cff56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6cff4f expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.914947:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7e400/0x4c16c38a9b6cff56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6cff4f expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.914956:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7e400/0x4c16c38a9b6cff56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6cff4f expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.914963:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e400, rc 0) 00000100:00100000:1.0:1788869712.914990:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:17095:x1875765325165952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869712.914996:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788869712.915029:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325165952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869712.915039:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.915053:0:17095:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869712.915092:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325166080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.915116:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.915128:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869712.915139:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325166080 00000100:00100000:1.0:1788869712.915142:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325166080 00000100:00100000:1.0:1788869712.915160:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788869712.915166:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:17095:x1875765325166080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.915241:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:17095:x1875765325166080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869712.915249:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788869712.915275:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325166080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.915296:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325166208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.915330:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869712.915342:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039b6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869712.915353:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325166208 00000100:00100000:1.0:1788869712.915356:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325166208 00000100:00100000:1.0:1788869712.915374:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788869712.915380:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:17095:x1875765325166208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869712.915458:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:17095:x1875765325166208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869712.915465:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788869712.915508:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71f22428-daa5-41c2-b06f-55c4031bf12e:17095:1875765325166208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788869712.927846:0:20185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788869712.928832:0:17095:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788869712.928860:0:17095:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869712.928873:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869712.928887:0:17095:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869712.975232:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869713.145158:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869713.145232:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305144448 00000100:00100000:1.0:1788869713.145245:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305144448 00000100:00100000:1.0:1788869713.145313:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:1.0:1788869713.145323:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+11:14914:x1875765305144448:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869713.145339:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869713.145357:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca242 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869713.145394:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca242 expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869713.145406:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca242 expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869713.145415:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ec00, rc 0) 00000100:00100000:1.0:1788869713.145482:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+12:14914:x1875765305144448:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 159us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869713.145488:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:1.0:1788869713.159767:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869713.162073:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305144576 00000100:00100000:3.0:1788869713.162090:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305144576 00000100:00100000:3.0:1788869713.162158:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:3.0:1788869713.162169:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+12:14914:x1875765305144576:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869713.162437:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+12:14914:x1875765305144576:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 268us (2749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869713.162446:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:0.0:1788869713.164532:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869713.164857:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305144704 00000100:00100000:1.0:1788869713.164867:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305144704 00000100:00100000:1.0:1788869713.164917:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:1.0:1788869713.164927:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+12:14914:x1875765305144704:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869713.165055:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+12:14914:x1875765305144704:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 128us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869713.165064:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:0.0:1788869713.176339:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869713.176793:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305144832 00000100:00100000:3.0:1788869713.176805:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305144832 00000100:00100000:3.0:1788869713.176866:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:3.0:1788869713.176877:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+12:14914:x1875765305144832:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869713.176896:0:17093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869713.176916:0:17093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9a00/0x4c16c38a9b6cff64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca249 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869713.176983:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9a00/0x4c16c38a9b6cff64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca249 expref: 13 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869713.176996:0:17093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed9a00/0x4c16c38a9b6cff64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca249 expref: 13 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869713.177006:0:17093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9a00, rc 0) 00000100:00100000:3.0:1788869713.177062:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+13:14914:x1875765305144832:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 186us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869713.177069:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:2.0:1788869713.180053:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869713.180404:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305144960 00000100:00100000:1.0:1788869713.180418:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305144960 00000100:00100000:1.0:1788869713.180491:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:1.0:1788869713.180503:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:14914:x1875765305144960:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869713.180710:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:14914:x1875765305144960:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 210us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869713.180718:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1788869713.189839:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869713.194092:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305145088 00000100:00100000:1.0:1788869713.194111:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305145088 00000100:00100000:1.0:1788869713.194176:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:1.0:1788869713.194188:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+13:14914:x1875765305145088:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869713.194338:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+13:14914:x1875765305145088:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 151us (4508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869713.194348:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 165 00010000:00010000:3.0:1788869713.478773:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869714.369892:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869714.370093:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305145344 00000100:00100000:1.0:1788869714.370106:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305145344 00000100:00100000:1.0:1788869714.370202:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788869714.370214:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+6:2408:x1875765305145344:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:2.0:1788869714.370351:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869714.375412:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+6:2408:x1875765305145344:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 4720us (5054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869714.375428:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1788869714.378372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869714.378424:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869714.378461:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869714.378500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869714.378520:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869714.378539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869714.378566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869714.378614:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869714.378651:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305145600 00000100:00100000:0.0:1788869714.378661:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305145600 00000100:00100000:0.0:1788869714.378712:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305146112 00000100:00100000:0.0:1788869714.378716:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305146112 00000100:00100000:0.0:1788869714.378742:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305145728 00000100:00100000:0.0:1788869714.378745:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305145728 00000100:00100000:0.0:1788869714.378757:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305146240 00000100:00100000:0.0:1788869714.378759:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305146240 00000100:00100000:0.0:1788869714.378776:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788869714.378786:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+5:2408:x1875765305145600:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869714.378854:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+5:2408:x1875765305145600:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 70us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869714.378862:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788869714.378877:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788869714.378886:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805c4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2408:x1875765305146112:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869714.378908:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805c4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2408:x1875765305146112:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869714.378914:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788869714.379057:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305145856 00000100:00100000:3.0:1788869714.379062:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305145856 00000100:00100000:3.0:1788869714.379096:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305145472 00000100:00100000:3.0:1788869714.379099:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305145472 00000100:00100000:3.0:1788869714.379113:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305145984 00000100:00100000:3.0:1788869714.379115:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305145984 00000100:00100000:3.0:1788869714.379131:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788869714.379138:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2408:x1875765305145856:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869714.379176:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2408:x1875765305145856:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869714.379183:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788869714.379195:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:3.0:1788869714.379201:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+5:2407:x1875765305145472:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869714.379223:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+5:2407:x1875765305145472:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869714.379246:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:3.0:1788869714.379258:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1788869714.379265:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305145984:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869714.379290:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305145984:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869714.379296:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1788869714.379314:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305145216 00000100:00100000:3.0:1788869714.379317:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305145216 00000100:00100000:3.0:1788869714.379344:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:3.0:1788869714.379350:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+13:2407:x1875765305145216:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869714.379385:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+13:2407:x1875765305145216:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869714.379392:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:3.0:1788869714.379423:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788869714.379430:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:2407:x1875765305145728:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869714.379459:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:2407:x1875765305145728:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869714.379464:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788869714.379477:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1788869714.379483:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305146240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869714.379505:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305146240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869714.379511:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00080000:2.0:1788869714.381245:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869714.381254:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869714.381257:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869714.381259:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869714.503553:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869715.270539:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869715.270568:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325166336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869715.270656:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869715.270840:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325166336 00000100:00100000:3.0:1788869715.270849:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325166336 00000100:00100000:3.0:1788869715.270938:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869715.270950:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325166336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869715.270982:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869715.271028:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325166336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.271035:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788869715.271193:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869715.271230:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325166336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869715.273544:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325166464:0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.273638:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869715.273698:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325166976:0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.273726:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869715.273744:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325167488:0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.273762:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869715.273783:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869715.273788:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325166848:0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.273812:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869715.273830:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325167360:0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.273849:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869715.273866:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325167872:0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.273894:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869715.273938:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325166976 00000100:00100000:1.0:1788869715.273946:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325166976 00000100:00100000:1.0:1788869715.273987:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325167488 00000100:00100000:1.0:1788869715.273990:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325167488 00000100:00100000:1.0:1788869715.274038:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325167360 00000100:00100000:1.0:1788869715.274042:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325167360 00000100:00100000:1.0:1788869715.274052:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325167872 00000100:00100000:1.0:1788869715.274054:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325167872 00000100:00100000:1.0:1788869715.274072:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788869715.274081:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325166976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.274136:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325166976:12345-0@lo:400:kworker.0 Request processed in 56us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869715.274144:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788869715.274160:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788869715.274166:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325167488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.274192:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325167488:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869715.274198:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788869715.274208:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788869715.274213:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325167360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.274237:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325167360:12345-0@lo:400:kworker.0 Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869715.274243:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788869715.274253:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788869715.274258:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325167872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.274280:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325167872:12345-0@lo:400:kworker.0 Request processed in 23us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869715.274285:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788869715.274299:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869715.274310:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869715.274356:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325167360:0@lo:400:kworker.0 00010000:00080000:1.0:1788869715.274380:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db34e00 x1875765325167872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869715.274391:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325167872:0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.274402:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325166976:0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.274410:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325167488:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.275267:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325166592:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.275347:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869715.275547:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325167104:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.275571:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869715.275623:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325167616:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.275646:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869715.275667:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788869715.275672:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325166720:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.275706:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869715.275724:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325167232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.275741:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869715.275758:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325167744:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.275780:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869715.275811:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325166592 00000100:00100000:3.0:1788869715.275817:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325166592 00000100:00100000:3.0:1788869715.275847:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325167104 00000100:00100000:3.0:1788869715.275849:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325167104 00000100:00100000:3.0:1788869715.275875:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869715.275882:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325166592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.275937:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325166592:12345-0@lo:400:kworker.0 Request processed in 55us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.275943:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869715.275958:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869715.275963:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325167104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.275985:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325167104:12345-0@lo:400:kworker.0 Request processed in 23us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.275990:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869715.276011:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325166848 00000100:00100000:3.0:1788869715.276014:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325166848 00000100:00100000:3.0:1788869715.276041:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325166720 00000100:00100000:3.0:1788869715.276044:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325166720 00000100:00100000:3.0:1788869715.276055:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325167232 00000100:00100000:3.0:1788869715.276057:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325167232 00000100:00100000:3.0:1788869715.276076:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869715.276081:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325166848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.276114:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325166848:12345-0@lo:400:kworker.0 Request processed in 33us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.276119:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869715.276129:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869715.276135:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325166720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.276156:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325166720:12345-0@lo:400:kworker.0 Request processed in 22us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.276161:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869715.276170:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869715.276182:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325167232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.276211:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325167232:12345-0@lo:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.276216:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869715.276241:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325167616 00000100:00100000:3.0:1788869715.276244:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325167616 00000100:00100000:3.0:1788869715.276263:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325167744 00000100:00100000:3.0:1788869715.276265:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325167744 00000100:00100000:3.0:1788869715.276276:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788869715.276282:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325167616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.276322:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325167616:12345-0@lo:400:kworker.0 Request processed in 41us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.276329:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788869715.276351:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788869715.276356:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325167744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.276381:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325167744:12345-0@lo:400:kworker.0 Request processed in 26us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.276387:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788869715.277466:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869715.277493:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325168000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869715.277547:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869715.277611:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325168000 00000100:00100000:0.0:1788869715.277618:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325168000 00000100:00100000:0.0:1788869715.277668:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869715.277678:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325168000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869715.277712:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869715.277752:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325168000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869715.277757:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869715.277797:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325168000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869715.278573:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325166464 00000100:00100000:2.0:1788869715.278581:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325166464 00000100:00100000:2.0:1788869715.278663:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788869715.278672:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3651:x1875765325166464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869715.278742:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3651:x1875765325166464:12345-0@lo:400:kworker.0 Request processed in 71us (5104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869715.278750:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1788869715.279156:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869715.279164:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869715.279166:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869715.279169:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869715.279206:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325166848:0@lo:400:kworker.0 00000100:00100000:1.0:1788869715.279217:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325166464:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.279272:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325166720:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.279292:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325167232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.279397:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325167744:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.279413:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325166592:0@lo:400:kworker.0 00000100:00100000:3.0:1788869715.279435:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325167104:0@lo:400:kworker.0 00010000:00080000:3.0:1788869715.279451:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282db34a80 x1875765325167616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869715.279474:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325167616:0@lo:400:kworker.0 00010000:00010000:3.0:1788869715.528523:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869715.739892:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869715.740022:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305146368 00000100:00100000:0.0:1788869715.740033:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305146368 00000100:00100000:0.0:1788869715.740120:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788869715.740133:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+6:15585:x1875765305146368:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869715.740155:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869715.740182:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cff6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca250 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740256:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740272:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740283:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740319:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740339:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740347:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740448:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5c00/0x4c16c38a9b6cff80 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740457:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5c00/0x4c16c38a9b6cff80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740463:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5c00/0x4c16c38a9b6cff80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869715.740498:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869715.740502:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869715.740544:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5c00/0x4c16c38a9b6cff80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740557:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740563:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740569:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740617:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869715.740634:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740643:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740656:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecc900) 00010000:00010000:0.0:1788869715.740659:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869715.740664:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740670:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740685:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740699:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740704:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740708:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4c00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869715.740711:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740717:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740816:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e28131c4b00) 00010000:00010000:0.0:1788869715.740819:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869715.740822:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740828:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740867:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cff6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca250 expref: 8 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740881:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5c00/0x4c16c38a9b6cff80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca250 expref: 7 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.740890:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e28131c4000) 00010000:00010000:0.0:1788869715.740892:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869715.740895:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5c00, rc 0) 00000100:00100000:0.0:1788869715.740988:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+7:15585:x1875765305146368:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 858us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869715.740998:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1788869715.755859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869715.756019:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305146496 00000100:00100000:2.0:1788869715.756032:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305146496 00000100:00100000:2.0:1788869715.756103:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1788869715.756114:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:893992aa-f001-4ff6-aa93-863511511bbf+7:15585:x1875765305146496:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788869715.756212:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:893992aa-f001-4ff6-aa93-863511511bbf+7:15585:x1875765305146496:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 100us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869715.756222:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788869715.766348:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869715.766619:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305146752 00000100:00100000:0.0:1788869715.766853:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305146752 00000100:00100000:0.0:1788869715.767055:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788869715.767069:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+7:15585:x1875765305146752:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869715.767093:0:19213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869715.767114:0:19213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca257 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.767210:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.767225:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.767237:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.767283:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.767293:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.767300:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.768560:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cff9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.768581:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cff9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.768604:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cff9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869715.768633:0:19213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788869715.770408:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771023:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771032:0:19213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771039:0:19213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869715.771044:0:19213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771056:0:19213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771074:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e28131c4000) 00010000:00010000:0.0:1788869715.771077:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869715.771082:0:19213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771087:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cff8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771103:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771108:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771113:0:19213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771118:0:19213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869715.771129:0:19213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771135:0:19213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771144:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e28131c4b00) 00010000:00010000:0.0:1788869715.771147:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869715.771150:0:19213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.771154:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cff95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.774462:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cff87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca257 expref: 10 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.774490:0:19213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cff9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca257 expref: 9 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869715.774499:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e28131c4a00) 00010000:00010000:0.0:1788869715.774501:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869715.774505:0:19213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5000, rc 0) 00000100:00100000:0.0:1788869715.774583:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+9:15585:x1875765305146752:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 7518us (8255us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788869715.774617:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1788869715.781863:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325168128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869715.781956:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869715.782151:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325168128 00000100:00100000:1.0:1788869715.782162:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325168128 00000100:00100000:1.0:1788869715.782216:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788869715.782226:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325168128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869715.782261:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788869715.784232:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325168256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869715.784299:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869715.784360:0:18608:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788869715.784370:0:18608:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788869715.784549:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325168256 00000100:00100000:2.0:1788869715.784570:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325168256 00000100:00100000:2.0:1788869715.784705:0:20240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869715.784714:0:20240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325168256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869715.784748:0:20240:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788869715.784791:0:20240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325168256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869715.784799:0:20240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869715.784842:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325168256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869715.791645:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869715.791719:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305146880 00000100:00100000:2.0:1788869715.791739:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305146880 00000100:00100000:2.0:1788869715.791800:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1788869715.791810:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+9:15585:x1875765305146880:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788869715.791927:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+9:15585:x1875765305146880:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 118us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869715.791935:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1788869715.793065:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325168128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10833us (11102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869715.793079:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869715.800479:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325168128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869715.800664:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869715.800853:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305147008 00000100:00100000:1.0:1788869715.800861:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305147008 00000100:00100000:1.0:1788869715.800926:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1788869715.800936:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:15585:x1875765305147008:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788869715.801503:0:17100:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 507us 00000100:00100000:2.0:1788869715.834068:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:15585:x1875765305147008:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 33120us (33392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869715.834083:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1788869715.904266:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869715.907653:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305147136 00000100:00100000:2.0:1788869715.907670:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305147136 00000100:00100000:2.0:1788869715.907755:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788869715.907766:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+9:15591:x1875765305147136:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869715.907785:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869715.907807:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6cffaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca25e expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.907887:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.907915:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.907929:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.907945:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.907951:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.907957:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908006:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908013:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908020:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908025:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869715.908029:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908047:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908060:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecc900) 00010000:00010000:2.0:1788869715.908063:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869715.908069:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908075:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6cffb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908090:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908095:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908101:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908105:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869715.908108:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908114:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908120:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e280839cb00) 00010000:00010000:2.0:1788869715.908122:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869715.908125:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908138:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6cffb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908172:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6cffaa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca25e expref: 10 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908182:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecc900) 00010000:00010000:2.0:1788869715.908185:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869715.908189:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6cffaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca25e expref: 10 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869715.908198:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042400, rc 0) 00000100:00100000:2.0:1788869715.908267:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+9:15591:x1875765305147136:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 503us (4015us total) trans 0 rc 301/301 00000100:00100000:2.0:1788869715.908274:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788869715.913875:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869715.914032:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305147264 00000100:00100000:3.0:1788869715.914042:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305147264 00000100:00100000:3.0:1788869715.914097:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788869715.914118:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:893992aa-f001-4ff6-aa93-863511511bbf+9:15591:x1875765305147264:12345-192.168.204.54@tcp:700:lfs.0 00000100:00100000:3.0:1788869715.914215:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:893992aa-f001-4ff6-aa93-863511511bbf+9:15591:x1875765305147264:12345-192.168.204.54@tcp:700:lfs.0 Request processed in 109us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.914223:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788869715.920949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869715.921094:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305147520 00000100:00100000:3.0:1788869715.921108:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305147520 00000100:00100000:3.0:1788869715.921177:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788869715.921188:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+9:15591:x1875765305147520:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:3.0:1788869715.921255:0:19213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869715.921289:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7fe00/0x4c16c38a9b6cfed8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca1cb expref: 9 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.921310:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecc900) 00010000:00010000:3.0:1788869715.921316:0:19213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869715.921414:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.921440:0:19213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca23b expref: 5 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.921450:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.921489:0:19213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca23b expref: 5 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.921504:0:19213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca23b expref: 5 pid: 17100 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869715.921517:0:19213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19213:1875765325168384:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869715.921822:0:19213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703927c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869715.933306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869715.933567:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305147648 00000100:00100000:3.0:1788869715.933580:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305147648 00010000:00010000:3.0:1788869715.933663:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca23b expref: 6 pid: 17100 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869715.933706:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1788869715.933715:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2409:x1875765305147648:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869715.933732:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869715.933741:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca23b expref: 6 pid: 17100 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.933755:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca23b expref: 6 pid: 17100 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.933797:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecc900) 00010000:00010000:3.0:1788869715.933803:0:17085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.933812:0:17085:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.933821:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869715.933846:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869715.933897:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2409:x1875765305147648:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 182us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869715.933904:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:1.0:1788869715.934361:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6cff17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca23b expref: 5 pid: 17100 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869715.934381:0:19213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19213:1875765325168384:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788869715.934403:0:19213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.934412:0:19213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.934417:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.934440:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.934450:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.934458:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953065:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953093:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953119:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869715.953145:0:19213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031ff14bc reply state 00000000e2c80db7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953158:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953165:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:1.0:1788869715.953168:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869715.953172:0:19213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788869715.953178:0:19213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788869715.953186:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953192:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953198:0:19213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953204:0:19213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869715.953208:0:19213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953215:0:19213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953225:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ecc900) 00010000:00010000:1.0:1788869715.953228:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869715.953239:0:19213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953246:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6cffbf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869715.953269:0:19213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031ff14bc reply state 00000000e2c80db7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953278:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869715.953284:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2701ed4100) 00010000:00010000:1.0:1788869715.953286:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869715.953288:0:19213:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788869715.953423:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+10:15591:x1875765305147520:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 32232us (32484us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788869715.953432:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000040:00080000:1.0:1788869716.038992:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788869716.042433:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869716.105385:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869716.105932:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305147776 00000100:00100000:0.0:1788869716.105944:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305147776 00000100:00100000:0.0:1788869716.106039:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1788869716.106087:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+10:15599:x1875765305147776:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:0.0:1788869716.106120:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869716.106147:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cffd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca265 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.106227:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cffdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.106244:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cffdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.106257:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cffdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869716.106313:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869716.106317:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869716.106370:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cffdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.106396:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cffd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca265 expref: 12 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.106428:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cffdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca265 expref: 11 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.106437:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:0.0:1788869716.106440:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869716.106443:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4a00, rc 0) 00000100:00100000:0.0:1788869716.106519:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+11:15599:x1875765305147776:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 454us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869716.106539:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00080000:1.0:1788869716.107399:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869716.159138:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869716.159261:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305147904 00000100:00100000:1.0:1788869716.159272:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305147904 00000100:00100000:1.0:1788869716.159372:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1788869716.159382:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:15600:x1875765305147904:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869716.159403:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869716.159437:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cffe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca26c expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.159504:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6cffe9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.159536:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6cffe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.159548:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6cffe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869716.159641:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869716.159645:0:17100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869716.159666:0:17100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6cffe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.159693:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6cffe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca26c expref: 7 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.159714:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6cffe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca26c expref: 6 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.159723:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:1.0:1788869716.159726:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869716.159729:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edbe00, rc 0) 00000100:00100000:1.0:1788869716.159801:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:15600:x1875765305147904:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 421us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869716.159809:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00080000:2.0:1788869716.160503:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869716.166545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869716.166656:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305148032 00000100:00100000:0.0:1788869716.166668:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305148032 00000100:00100000:0.0:1788869716.166753:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1788869716.166765:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:15600:x1875765305148032:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869716.166788:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869716.166811:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cfff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca273 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.166879:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.166894:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.166906:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.166916:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.166923:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.166928:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167030:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d0005 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167063:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d0005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167072:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d0005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869716.167126:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869716.167130:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869716.167155:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d0005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167167:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167174:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167180:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167186:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4c00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869716.167190:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167198:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167210:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:0.0:1788869716.167214:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869716.167219:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167236:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4c00/0x4c16c38a9b6cfff7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167252:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167257:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167263:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167267:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869716.167271:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167276:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167282:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2701ed4100) 00010000:00010000:0.0:1788869716.167285:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869716.167287:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167293:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6cfffe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167318:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6cfff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca273 expref: 8 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167355:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d0005 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca273 expref: 7 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.167361:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:0.0:1788869716.167364:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869716.167366:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4200, rc 0) 00000100:00100000:0.0:1788869716.167439:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+7:15600:x1875765305148032:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 678us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869716.167447:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1788869716.171358:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869716.171577:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305148160 00000100:00100000:1.0:1788869716.171614:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305148160 00000100:00100000:1.0:1788869716.171700:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788869716.171712:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:15600:x1875765305148160:12345-192.168.204.54@tcp:900:lfs.0 00000100:00100000:1.0:1788869716.171801:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:15600:x1875765305148160:12345-192.168.204.54@tcp:900:lfs.0 Request processed in 91us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869716.171825:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00080000:3.0:1788869716.173163:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869716.176394:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.176538:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305148416 00000100:00100000:3.0:1788869716.176548:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305148416 00000100:00100000:3.0:1788869716.176647:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788869716.176657:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+7:15600:x1875765305148416:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869716.176680:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869716.176715:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6d000c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca27a expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869716.176844:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788869716.177382:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6d000c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca27a expref: 9 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.177415:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:3.0:1788869716.177418:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869716.177424:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6d000c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca27a expref: 9 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.177440:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8600, rc 0) 00000100:00100000:3.0:1788869716.177512:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+8:15600:x1875765305148416:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 857us (1131us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788869716.177520:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:1.0:1788869716.185340:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869716.185446:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305148672 00000100:00100000:0.0:1788869716.185458:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305148672 00000100:00100000:0.0:1788869716.185535:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788869716.185545:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+8:15600:x1875765305148672:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:0.0:1788869716.185638:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869716.185668:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d0005 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca273 expref: 8 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.185687:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:0.0:1788869716.185693:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869716.185715:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.185728:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.185738:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869716.185981:0:17099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083fce2be reply state 000000004c96b3f1 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.185993:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.186000:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:0.0:1788869716.186002:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788869716.186004:0:17099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788869716.186011:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788869716.186086:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+9:15600:x1875765305148672:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 541us (767us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788869716.186093:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788869716.192794:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869716.193163:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305148928 00000100:00100000:2.0:1788869716.193175:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305148928 00000100:00100000:2.0:1788869716.193247:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788869716.193259:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+9:15600:x1875765305148928:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869716.193569:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+10:15600:x1875765305148928:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 310us (783us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788869716.193611:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1788869716.198210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869716.198362:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305149184 00000100:00100000:0.0:1788869716.198372:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305149184 00000100:00100000:0.0:1788869716.198465:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1788869716.198479:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+10:15600:x1875765305149184:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869716.198505:0:19213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869716.198528:0:19213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca281 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.199833:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.199860:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.199873:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.199889:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.199896:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.199974:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869716.200104:0:19213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788869716.200520:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200529:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200536:0:19213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200564:0:19213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869716.200568:0:19213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200576:0:19213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200796:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:1.0:1788869716.200800:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869716.200807:0:19213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200814:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200830:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200836:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200842:0:19213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200847:0:19213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869716.200850:0:19213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200856:0:19213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200874:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2701ed4100) 00010000:00010000:1.0:1788869716.200876:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869716.200879:0:19213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.200886:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d002f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.201001:0:19213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0021 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca281 expref: 12 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.201012:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:1.0:1788869716.201015:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869716.201020:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca281 expref: 12 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869716.201495:0:19213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4e00, rc 0) 00000100:00100000:1.0:1788869716.201733:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+11:15600:x1875765305149184:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3256us (3530us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788869716.201745:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1788869716.209568:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869716.209893:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305149312 00000100:00100000:2.0:1788869716.209967:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305149312 00000100:00100000:2.0:1788869716.210077:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:2.0:1788869716.210091:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+11:15600:x1875765305149312:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869716.210118:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869716.210143:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d003d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca288 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.210260:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.210275:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.210287:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869716.210313:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869716.210317:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869716.210348:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.210377:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d003d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca288 expref: 13 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.210397:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca288 expref: 12 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.210502:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:2.0:1788869716.210505:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869716.210510:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842043800, rc 0) 00000100:00100000:2.0:1788869716.210671:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+12:15600:x1875765305149312:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 581us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.210679:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788869716.226048:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869716.228074:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305149440 00000100:00100000:2.0:1788869716.228091:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305149440 00000100:00100000:2.0:1788869716.228169:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1788869716.228181:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+12:15600:x1875765305149440:12345-192.168.204.54@tcp:37:lfs.0 00000100:00100000:2.0:1788869716.238703:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+12:15600:x1875765305149440:12345-192.168.204.54@tcp:37:lfs.0 Request processed in 10504us (12649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.238717:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788869716.251781:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.251908:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305149696 00000100:00100000:3.0:1788869716.251919:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305149696 00000100:00100000:3.0:1788869716.251979:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788869716.251989:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840a40c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+12:15600:x1875765305149696:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869716.252220:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840a40c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+13:15600:x1875765305149696:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 232us (449us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788869716.252228:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788869716.294627:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325168512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869716.294729:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869716.294873:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325168512 00000100:00100000:2.0:1788869716.294881:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325168512 00000100:00100000:2.0:1788869716.294950:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788869716.294959:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325168512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869716.294999:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788869716.295053:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325168512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.295059:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788869716.295807:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325168640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869716.295856:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869716.296047:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325168640 00000100:00100000:3.0:1788869716.296054:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325168640 00000100:00100000:3.0:1788869716.296094:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869716.296103:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325168640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869716.296128:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788869716.296178:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325168640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869716.296184:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788869716.296508:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325168512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869716.296977:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325168640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869716.339081:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.339224:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305149824 00000100:00100000:3.0:1788869716.339326:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305149824 00000100:00100000:3.0:1788869716.339397:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1788869716.339468:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+11:15606:x1875765305149824:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788869716.339492:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869716.339513:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6d004b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca28f expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339576:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339627:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339641:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339656:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339663:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339668:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339754:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6d0060 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339764:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6d0060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339771:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6d0060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869716.339815:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869716.339819:0:17100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869716.339858:0:17100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6d0060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339882:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.339889:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343544:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343571:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869716.343579:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343599:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343621:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:3.0:1788869716.343624:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869716.343629:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343637:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d0052 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343662:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343693:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343700:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343705:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869716.343708:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343714:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343722:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2701ed4100) 00010000:00010000:3.0:1788869716.343725:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869716.343728:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343734:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d0059 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343793:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6d004b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca28f expref: 13 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343814:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6d0060 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca28f expref: 12 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.343822:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:3.0:1788869716.343824:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788869716.343833:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9000, rc 0) 00000100:00100000:3.0:1788869716.343933:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+12:15606:x1875765305149824:12345-192.168.204.54@tcp:101:bash.0 Request processed in 4467us (4861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869716.343943:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788869716.351085:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869716.352646:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305149952 00000100:00100000:2.0:1788869716.352665:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305149952 00000100:00100000:2.0:1788869716.352832:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788869716.352845:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:893992aa-f001-4ff6-aa93-863511511bbf+5:15606:x1875765305149952:12345-192.168.204.54@tcp:900:bash.0 00000100:00100000:2.0:1788869716.352973:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:893992aa-f001-4ff6-aa93-863511511bbf+5:15606:x1875765305149952:12345-192.168.204.54@tcp:900:bash.0 Request processed in 131us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.352982:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00080000:3.0:1788869716.353163:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869716.366829:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.367368:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305150208 00000100:00100000:3.0:1788869716.367380:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305150208 00000100:00100000:3.0:1788869716.367448:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:3.0:1788869716.367459:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+12:15606:x1875765305150208:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788869716.367480:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869716.367503:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6d0067 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca296 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.367677:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.367932:0:17098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca288 expref: 12 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.367943:0:17098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.367987:0:17098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca288 expref: 12 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.368003:0:17098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca288 expref: 12 pid: 17099 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869716.368017:0:17098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17098:1875765325168768:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869716.368140:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280cf39180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869716.378555:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.378734:0:17098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17098:1875765325168768:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869716.378762:0:17098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869716.379050:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305150336 00000100:00100000:2.0:1788869716.379058:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305150336 00010000:00010000:2.0:1788869716.379095:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca288 expref: 13 pid: 17099 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869716.379132:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788869716.379142:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+13:2410:x1875765305150336:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869716.379160:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869716.379167:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca288 expref: 13 pid: 17099 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.379179:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca288 expref: 13 pid: 17099 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.379202:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0044 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca288 expref: 13 pid: 17099 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.379219:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:2.0:1788869716.379224:0:17083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.379235:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.379243:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.379293:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869716.379362:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+12:2410:x1875765305150336:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 221us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.379370:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00010000:00010000:0.0:1788869716.379483:0:17098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.379492:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.379519:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.379528:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.379536:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.380333:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.380349:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.380358:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869716.380369:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788869716.380397:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.380985:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.381008:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.381014:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869716.381020:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.381029:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.381045:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:0.0:1788869716.381048:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869716.381053:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.381060:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9200/0x4c16c38a9b6d006e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869716.381076:0:17098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dd56418 reply state 00000000bf19264b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.381087:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.381095:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e28131c4400) 00010000:00010000:0.0:1788869716.381098:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869716.381101:0:17098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788869716.381147:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8600/0x4c16c38a9b6d0067 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca296 expref: 15 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.381164:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca296 expref: 14 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869716.381179:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:0.0:1788869716.381182:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788869716.381185:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5400, rc 0) 00000100:00100000:0.0:1788869716.381249:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+15:15606:x1875765305150208:12345-192.168.204.54@tcp:101:bash.0 Request processed in 13792us (14432us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788869716.381258:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:1.0:1788869716.398785:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.399129:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305150464 00000100:00100000:3.0:1788869716.399142:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305150464 00000100:00100000:3.0:1788869716.399204:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1788869716.399214:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+15:15606:x1875765305150464:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788869716.399242:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869716.399265:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d008a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca29d expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.399342:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6d0091 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.399356:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6d0091 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.399368:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6d0091 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869716.399436:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788869716.399442:0:17100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869716.399462:0:17100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6d0091 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.399471:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6d0091 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.399510:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d008a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca29d expref: 17 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.399529:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6d0091 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca29d expref: 16 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.399537:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869716.399539:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869716.399543:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9c00, rc 0) 00000100:00100000:3.0:1788869716.399661:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+16:15606:x1875765305150464:12345-192.168.204.54@tcp:101:bash.0 Request processed in 448us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869716.399668:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1788869716.411471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.411569:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305150720 00000100:00100000:3.0:1788869716.411581:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305150720 00000100:00100000:3.0:1788869716.411682:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788869716.411706:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+16:15606:x1875765305150720:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1788869716.412009:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+17:15606:x1875765305150720:12345-192.168.204.54@tcp:35:bash.0 Request processed in 305us (546us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788869716.412017:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788869716.539900:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869716.540076:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305150976 00000100:00100000:2.0:1788869716.540088:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305150976 00000100:00100000:2.0:1788869716.540231:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1788869716.540245:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+17:15616:x1875765305150976:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869716.540276:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869716.540300:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0098 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2a4 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869716.540453:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788869716.540573:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0098 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2a4 expref: 19 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.540697:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:2.0:1788869716.540701:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869716.540707:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0098 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2a4 expref: 19 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.540722:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842043800, rc 0) 00000100:00100000:2.0:1788869716.540823:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+18:15616:x1875765305150976:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 582us (934us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788869716.540831:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788869716.546418:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.546576:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305151232 00000100:00100000:3.0:1788869716.546795:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305151232 00000100:00100000:3.0:1788869716.546901:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1788869716.546913:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+18:15616:x1875765305151232:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869716.547179:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+19:15616:x1875765305151232:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 268us (783us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788869716.547204:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00010000:00010000:3.0:1788869716.549887:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869716.601009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.601132:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305151488 00000100:00100000:3.0:1788869716.601143:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305151488 00000100:00100000:3.0:1788869716.601210:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788869716.601221:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+19:15619:x1875765305151488:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869716.601248:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869716.601273:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2ab expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.601421:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6d00ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.601436:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6d00ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.601448:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6d00ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869716.601460:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788869716.601637:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ab expref: 22 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.601657:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6d00ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ab expref: 21 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.601667:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869716.601670:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869716.601699:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9e00, rc 0) 00000100:00100000:3.0:1788869716.601765:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+21:15619:x1875765305151488:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 545us (772us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788869716.601772:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:0.0:1788869716.607683:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.607880:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305151616 00000100:00100000:3.0:1788869716.607891:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305151616 00000100:00100000:3.0:1788869716.607970:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1788869716.607982:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+21:15619:x1875765305151616:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788869716.608067:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.608087:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.608100:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.608135:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.608142:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.608149:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.608155:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869716.608159:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.608166:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.608192:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869716.608195:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869716.608200:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869716.608205:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869716.608283:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+21:15619:x1875765305151616:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 303us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869716.608291:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1788869716.617087:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869716.617339:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305151872 00000100:00100000:3.0:1788869716.617349:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305151872 00000100:00100000:3.0:1788869716.617417:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788869716.617427:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+21:15619:x1875765305151872:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869716.617861:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+22:15619:x1875765305151872:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 434us (783us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788869716.617869:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788869716.629369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869716.633633:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305152000 00000100:00100000:2.0:1788869716.633670:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305152000 00000100:00100000:2.0:1788869716.633769:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788869716.633782:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:893992aa-f001-4ff6-aa93-863511511bbf+22:2409:x1875765305152000:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869716.633802:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869716.633834:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9e00/0x4c16c38a9b6d00ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ab expref: 22 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869716.633858:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869716.633869:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869716.633942:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:893992aa-f001-4ff6-aa93-863511511bbf+21:2409:x1875765305152000:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 162us (4585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.633949:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788869717.015355:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869717.016463:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305152256 00000100:00100000:3.0:1788869717.016477:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305152256 00000100:00100000:3.0:1788869717.016553:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788869717.016564:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+21:15650:x1875765305152256:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1788869717.017356:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869717.017383:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6d00c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2b2 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869717.017501:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869717.017527:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869717.017540:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869717.017552:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788869717.019490:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6d00c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2b2 expref: 24 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869717.019517:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2b2 expref: 23 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869717.019527:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869717.019529:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869717.019533:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9600, rc 0) 00000100:00100000:3.0:1788869717.020863:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+23:15650:x1875765305152256:12345-192.168.204.54@tcp:101:cat.0 Request processed in 4288us (5506us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788869717.020877:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788869717.027992:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869717.029952:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869717.030837:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305152640 00000100:00100000:2.0:1788869717.030850:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305152640 00000100:00100000:2.0:1788869717.030934:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788869717.030947:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+23:2409:x1875765305152640:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869717.030964:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869717.031181:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9600/0x4c16c38a9b6d00c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2b2 expref: 23 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.031204:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869717.031282:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869717.031470:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305152512 00000100:00100000:0.0:1788869717.031476:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305152512 00000100:00100000:0.0:1788869717.031532:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788869717.031541:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+23:15650:x1875765305152512:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1788869717.031924:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+24:2409:x1875765305152640:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 978us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869717.031934:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1788869717.036206:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+23:15650:x1875765305152512:12345-192.168.204.54@tcp:35:cat.0 Request processed in 4653us (8211us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788869717.036224:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788869717.126849:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869717.127174:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305152896 00000100:00100000:0.0:1788869717.127185:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305152896 00000100:00100000:0.0:1788869717.127270:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1788869717.127282:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+23:15656:x1875765305152896:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:0.0:1788869717.127326:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869717.127358:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6d00d7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2b9 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869717.127504:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d00de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869717.127536:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d00de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869717.127550:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d00de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869717.127565:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788869717.127772:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4800/0x4c16c38a9b6d00d7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2b9 expref: 26 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869717.127792:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d00de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2b9 expref: 25 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869717.127803:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:0.0:1788869717.127806:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869717.127809:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4000, rc 0) 00000100:00100000:0.0:1788869717.135761:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+25:15656:x1875765305152896:12345-192.168.204.54@tcp:101:dd.0 Request processed in 8463us (8905us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788869717.135776:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1788869717.140327:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869717.140376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869717.140458:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305153024 00000100:00100000:2.0:1788869717.140469:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305153024 00000100:00100000:2.0:1788869717.140552:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788869717.140563:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+25:15656:x1875765305153024:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1788869717.140607:0:19213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869717.140628:0:19213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00ec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2c0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.140665:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.140680:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.140691:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.140821:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c0 expref: 27 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.140840:0:19213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c0 expref: 26 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.140849:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869717.140852:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869717.140855:0:19213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042a00, rc 0) 00000100:00100000:2.0:1788869717.141009:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+26:15656:x1875765305153024:12345-192.168.204.54@tcp:101:dd.0 Request processed in 447us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869717.141015:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788869717.141813:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305153152 00000100:00100000:3.0:1788869717.141823:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305153152 00000100:00100000:3.0:1788869717.141897:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788869717.141906:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:893992aa-f001-4ff6-aa93-863511511bbf+26:2410:x1875765305153152:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869717.141918:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869717.141947:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d00de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2b9 expref: 26 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869717.141964:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869717.141969:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869717.142790:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:893992aa-f001-4ff6-aa93-863511511bbf+25:2410:x1875765305153152:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 871us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869717.142800:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1788869717.155123:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869717.155269:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305153408 00000100:00100000:2.0:1788869717.155282:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305153408 00000100:00100000:2.0:1788869717.155398:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1788869717.155412:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+25:15656:x1875765305153408:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:2.0:1788869717.155486:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869717.155525:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9c00/0x4c16c38a9b6d0091 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca29d expref: 25 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.155548:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869717.155553:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869717.155771:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.155786:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.155798:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869717.155849:0:17099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788869717.155887:0:17099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d12c4866 reply state 000000008f6a4593 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.155903:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.155911:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869717.155914:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869717.155917:0:17099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869717.156340:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+27:15656:x1875765305153408:12345-192.168.204.54@tcp:36:dd.0 Request processed in 929us (1230us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788869717.156350:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000020:00080000:2.0:1788869717.156367:0:17099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788869717.286324:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869717.286519:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305153664 00000100:00100000:2.0:1788869717.286530:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305153664 00000100:00100000:2.0:1788869717.286678:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788869717.286690:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+27:15656:x1875765305153664:12345-192.168.204.54@tcp:35:dd.0 00000100:00100000:2.0:1788869717.286931:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+28:15656:x1875765305153664:12345-192.168.204.54@tcp:35:dd.0 Request processed in 243us (615us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788869717.286938:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788869717.541435:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869717.541541:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305153792 00000100:00100000:1.0:1788869717.541553:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305153792 00000100:00100000:1.0:1788869717.541647:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788869717.541657:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+28:15670:x1875765305153792:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:1.0:1788869717.541682:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869717.541715:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0101 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2c7 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.541788:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.541803:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.541814:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.541824:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.541830:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.541853:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.541924:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0116 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.541933:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0116 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.541939:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0116 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869717.541985:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788869717.541988:0:17100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869717.542025:0:17100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0116 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542037:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0116 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542045:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542051:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542058:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542063:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869717.542067:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542081:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542093:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:1.0:1788869717.542096:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869717.542101:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542108:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0108 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542122:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542128:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542134:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542140:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869717.542143:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542149:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542155:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e28131c4400) 00010000:00010000:1.0:1788869717.542158:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869717.542161:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542177:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d010f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542205:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0101 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c7 expref: 30 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542218:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0116 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c7 expref: 29 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.542226:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:1.0:1788869717.542228:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869717.542230:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb400, rc 0) 00000100:00100000:1.0:1788869717.542310:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+29:15670:x1875765305153792:12345-192.168.204.54@tcp:101:stat.0 Request processed in 654us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869717.542317:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00010000:00010000:3.0:1788869717.575551:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869717.624049:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869717.624211:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305154048 00000100:00100000:2.0:1788869717.624222:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305154048 00000100:00100000:2.0:1788869717.624301:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1788869717.624312:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+29:15676:x1875765305154048:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:2.0:1788869717.624373:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869717.624402:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0116 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c7 expref: 29 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.624434:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869717.624440:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869717.624658:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.624673:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.624683:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869717.624728:0:17099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788869717.624751:0:17099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cd827a4 reply state 00000000dfd42221 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.624775:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.624782:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869717.624784:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869717.624787:0:17099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869717.624933:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+31:15676:x1875765305154048:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 614us (888us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788869717.624941:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000020:00080000:2.0:1788869717.624947:0:17099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788869717.891716:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869717.892128:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305154176 00000100:00100000:1.0:1788869717.892142:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305154176 00000100:00100000:1.0:1788869717.892219:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1788869717.892231:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+31:15690:x1875765305154176:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:1.0:1788869717.892260:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869717.892283:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0124 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2ce expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892369:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892403:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892416:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892429:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892437:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892445:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892518:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892529:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892537:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869717.892630:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788869717.892636:0:17100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869717.892658:0:17100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892672:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892693:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892700:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892709:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892716:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869717.892721:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892730:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892743:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:1.0:1788869717.892746:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869717.892752:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892759:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d012b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892777:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892784:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892791:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892802:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869717.892806:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892813:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892822:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e28131c4400) 00010000:00010000:1.0:1788869717.892825:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869717.892828:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892835:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0132 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892865:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d0124 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ce expref: 33 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892878:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ce expref: 32 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.892886:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:1.0:1788869717.892888:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869717.892891:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edac00, rc 0) 00000100:00100000:1.0:1788869717.893276:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+32:15690:x1875765305154176:12345-192.168.204.54@tcp:101:stat.0 Request processed in 1046us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869717.893296:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788869718.011735:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869718.012633:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305154432 00000100:00100000:2.0:1788869718.012647:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305154432 00000100:00100000:2.0:1788869718.012882:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1788869718.012895:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+32:15700:x1875765305154432:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869718.012915:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869718.012937:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2d5 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869718.013060:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788869718.013178:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0140 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2d5 expref: 34 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.013193:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:2.0:1788869718.013196:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869718.013202:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2d5 expref: 34 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.013227:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842043400, rc 0) 00000100:00100000:2.0:1788869718.013309:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+33:15700:x1875765305154432:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 417us (1587us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788869718.013318:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00080000:3.0:1788869718.015982:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869718.017988:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869718.018219:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305154688 00000100:00100000:0.0:1788869718.018230:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305154688 00000100:00100000:0.0:1788869718.018350:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1788869718.018363:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840a41850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+33:15700:x1875765305154688:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788869718.018671:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840a41850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+34:15700:x1875765305154688:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 311us (692us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788869718.018679:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788869718.071868:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869718.071993:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305154944 00000100:00100000:2.0:1788869718.072004:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305154944 00000100:00100000:2.0:1788869718.072082:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1788869718.072093:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+34:15706:x1875765305154944:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869718.072122:0:19213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869718.072149:0:19213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d014e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2dc expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.072278:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.072305:0:19213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca296 expref: 35 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.072314:0:19213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ce expref: 35 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.072323:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.072362:0:19213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ce expref: 35 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.072399:0:19213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ce expref: 35 pid: 17100 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869718.072414:0:19213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19213:1875765325168896:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869718.072516:0:19213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca296 expref: 35 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.072526:0:19213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca296 expref: 35 pid: 17098 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869718.072535:0:19213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19213:1875765325169024:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869718.072557:0:19213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869718.079585:0:19213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19213:1875765325168896:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869718.079895:0:19213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19213:1875765325169024:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869718.079926:0:19213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869718.082230:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869718.082527:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869718.082952:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305155200 00000100:00100000:3.0:1788869718.082963:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305155200 00010000:00010000:3.0:1788869718.083016:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca296 expref: 36 pid: 17098 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869718.083104:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305155072 00000100:00100000:3.0:1788869718.083108:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305155072 00010000:00010000:3.0:1788869718.083131:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ce expref: 37 pid: 17100 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869718.083422:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788869718.083532:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27025f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+37:2410:x1875765305155200:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869718.083548:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869718.083556:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca296 expref: 37 pid: 17098 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083569:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca296 expref: 37 pid: 17098 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083635:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d007c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca296 expref: 37 pid: 17098 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083651:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869718.083656:0:17085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083665:0:17085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083671:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869718.083784:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27025f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+36:2410:x1875765305155200:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 259us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869718.083792:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788869718.083856:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788869718.083865:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+35:2410:x1875765305155072:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869718.083874:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869718.083879:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ce expref: 35 pid: 17100 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083890:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ce expref: 35 pid: 17100 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083903:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0139 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ce expref: 35 pid: 17100 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083927:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869718.083931:0:17085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083939:0:17085:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083947:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.083971:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869718.083992:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+34:2410:x1875765305155072:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 128us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869718.083998:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00010000:00010000:1.0:1788869718.084091:0:19213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869718.084100:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869718.084118:0:19213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788869718.084271:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d014e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2dc expref: 35 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869718.084298:0:19213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2dc expref: 34 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869718.084317:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:1.0:1788869718.084321:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869718.084323:0:19213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042200, rc 0) 00000100:00100000:1.0:1788869718.084351:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+34:15706:x1875765305154944:12345-192.168.204.54@tcp:101:bash.0 Request processed in 12261us (12510us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788869718.084358:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:3.0:1788869718.092110:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869718.092196:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305155456 00000100:00100000:2.0:1788869718.092207:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305155456 00000100:00100000:2.0:1788869718.092271:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1788869718.092281:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+34:15706:x1875765305155456:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1788869718.092543:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.092562:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.092574:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869718.092649:0:17099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788869718.092671:0:17099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000373c11d4 reply state 0000000013122521 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.092694:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.092701:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869718.092704:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869718.092708:0:17099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869718.092786:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+37:15706:x1875765305155456:12345-192.168.204.54@tcp:36:bash.0 Request processed in 505us (685us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788869718.092794:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000020:00080000:2.0:1788869718.092799:0:17099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788869718.101066:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869718.101182:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305155584 00000100:00100000:1.0:1788869718.101192:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305155584 00000100:00100000:1.0:1788869718.101259:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1788869718.101270:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+37:15706:x1875765305155584:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869718.101305:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869718.101326:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d016a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2e3 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869718.101394:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d016a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2e3 expref: 38 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869718.101410:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d016a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2e3 expref: 38 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869718.101430:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:1.0:1788869718.101433:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869718.101437:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda600, rc 0) 00000100:00100000:1.0:1788869718.101500:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+38:15706:x1875765305155584:12345-192.168.204.54@tcp:101:bash.0 Request processed in 232us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869718.101507:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1788869718.109997:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869718.110144:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305155712 00000100:00100000:2.0:1788869718.110155:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305155712 00000100:00100000:2.0:1788869718.110217:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1788869718.110228:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+38:15706:x1875765305155712:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869718.110250:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869718.110271:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0171 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2ea expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.110400:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.110415:0:17099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2dc expref: 39 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.110433:0:17099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.110471:0:17099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2dc expref: 39 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.110502:0:17099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2dc expref: 39 pid: 19213 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869718.110515:0:17099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17099:1875765325169152:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869718.110649:0:17099:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869718.116483:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869718.116804:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305155840 00000100:00100000:0.0:1788869718.116817:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305155840 00010000:00010000:0.0:1788869718.116888:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2dc expref: 40 pid: 19213 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869718.116934:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788869718.116947:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:893992aa-f001-4ff6-aa93-863511511bbf+40:2408:x1875765305155840:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869718.116961:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869718.116968:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2dc expref: 40 pid: 19213 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.116981:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2dc expref: 40 pid: 19213 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.117004:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:0.0:1788869718.117009:0:17084:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.117019:0:17084:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.117027:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.117051:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869718.117105:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:893992aa-f001-4ff6-aa93-863511511bbf+40:2408:x1875765305155840:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 162us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869718.117113:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:2.0:1788869718.117790:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d0155 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2dc expref: 39 pid: 19213 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869718.117810:0:17099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17099:1875765325169152:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869718.117832:0:17099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.117842:0:17099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.117848:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869718.117970:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869718.117975:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869718.117997:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.118029:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0171 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ea expref: 39 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.118046:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ea expref: 38 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.118075:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869718.118078:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869718.118081:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6e00, rc 0) 00000100:00100000:2.0:1788869718.118130:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+38:15706:x1875765305155712:12345-192.168.204.54@tcp:101:bash.0 Request processed in 7904us (8142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869718.118137:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1788869718.121766:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869718.121955:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305156096 00000100:00100000:2.0:1788869718.121965:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305156096 00000100:00100000:2.0:1788869718.122074:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1788869718.122086:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+38:15706:x1875765305156096:12345-192.168.204.54@tcp:103:bash.0 00010000:00010000:2.0:1788869718.122102:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788869718.122131:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d016a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2e3 expref: 38 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.122154:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d0178 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ea expref: 37 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869718.122165:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869718.122170:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869718.122230:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+36:15706:x1875765305156096:12345-192.168.204.54@tcp:103:bash.0 Request processed in 147us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869718.122238:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788869718.124980:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869718.125121:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305156224 00000100:00100000:1.0:1788869718.125131:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305156224 00000100:00100000:1.0:1788869718.125197:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:1.0:1788869718.125208:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+36:15706:x1875765305156224:12345-192.168.204.54@tcp:58:bash.0 00010000:00010000:1.0:1788869718.125326:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869718.125343:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869718.125354:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869718.127383:0:17100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869718.127678:0:17100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788869718.131148:0:17100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788869718.131296:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+36:15706:x1875765305156224:12345-192.168.204.54@tcp:58:bash.0 Request processed in 6073us (6310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869718.131309:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1788869718.142276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869718.142393:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305156352 00000100:00100000:0.0:1788869718.142416:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305156352 00000100:00100000:0.0:1788869718.142496:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1788869718.142509:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+36:15706:x1875765305156352:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869718.142531:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869718.142552:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2f1 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.142652:0:17098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.142663:0:17098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f1 expref: 37 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.142680:0:17098:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.142695:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f1 expref: 37 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.142708:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:0.0:1788869718.142711:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869718.142714:0:17098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f1 expref: 37 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869718.142722:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4600, rc 0) 00000100:00100000:0.0:1788869718.142777:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+37:15706:x1875765305156352:12345-192.168.204.54@tcp:101:bash.0 Request processed in 272us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869718.142784:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00010000:00010000:3.0:1788869718.598428:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869719.110348:0:17132:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788869719.110374:0:17132:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869719.110406:0:17132:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788869719.110487:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788869719.111278:0:17132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17132:1875765325169280:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869719.111456:0:17132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869719.121671:0:17132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17132:1875765325169280:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869719.122900:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.124389:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305156480 00000100:00100000:2.0:1788869719.124511:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305156480 00000100:00100000:2.0:1788869719.124692:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1788869719.124713:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+37:15707:x1875765305156480:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788869719.124763:0:19213:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788869719.124900:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+37:15707:x1875765305156480:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 197us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.124907:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1788869719.144006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.144109:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305156608 00000100:00100000:2.0:1788869719.144120:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305156608 00000100:00100000:2.0:1788869719.144175:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1788869719.144185:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+37:15707:x1875765305156608:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788869719.144272:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144291:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144306:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144338:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144346:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144353:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144376:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144384:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144420:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869719.144472:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869719.144476:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869719.144491:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144502:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144509:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144516:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144523:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869719.144527:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144535:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144546:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e28131c4a00) 00010000:00010000:2.0:1788869719.144548:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869719.144553:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144559:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6e00/0x4c16c38a9b6d018d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144582:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144637:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144643:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144648:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869719.144651:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144657:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144664:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e280839cb00) 00010000:00010000:2.0:1788869719.144666:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869719.144669:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144675:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6800/0x4c16c38a9b6d0194 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144689:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.144694:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.145135:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.145152:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869719.145156:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.145162:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.145172:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869719.145174:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869719.145178:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.145183:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d019b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869719.145325:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+37:15707:x1875765305156608:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 1139us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.145334:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788869719.163043:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869719.164219:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305156864 00000100:00100000:1.0:1788869719.164234:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305156864 00000100:00100000:1.0:1788869719.164326:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1788869719.164339:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+37:15707:x1875765305156864:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869719.164368:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869719.164405:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d01a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2f8 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.164889:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.164907:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.164921:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869719.164933:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788869719.165012:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.165021:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.165047:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.165053:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.165058:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.165067:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.165080:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:1.0:1788869719.165083:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869719.165303:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.165312:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.165369:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d01a2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f8 expref: 39 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.165381:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e28131c4a00) 00010000:00010000:1.0:1788869719.165383:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869719.165398:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d01a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f8 expref: 39 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.166196:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda600, rc 0) 00000100:00100000:1.0:1788869719.166302:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+38:15707:x1875765305156864:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1962us (3270us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1788869719.166325:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:3.0:1788869719.172753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.172798:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305156992 00000100:00100000:0.0:1788869719.172811:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305156992 00000100:00100000:0.0:1788869719.172906:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1788869719.172919:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+38:15707:x1875765305156992:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869719.172973:0:17098:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869719.173214:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+38:15707:x1875765305156992:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 298us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869719.173222:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1788869719.179534:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.179795:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305157248 00000100:00100000:2.0:1788869719.179805:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305157248 00000100:00100000:2.0:1788869719.179875:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1788869719.179887:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+38:15707:x1875765305157248:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869719.179909:0:19213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869719.179929:0:19213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca2ff expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869719.181578:0:19213:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1788869719.181808:0:19213:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788869719.182271:0:19213:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788869719.182693:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d01be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.182714:0:19213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d01be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.182726:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d01be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.182807:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ff expref: 41 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.182828:0:19213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d01be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ff expref: 40 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.182837:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:2.0:1788869719.182840:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869719.182911:0:19213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042200, rc 0) 00000100:00100000:2.0:1788869719.182998:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+40:15707:x1875765305157248:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3112us (3474us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788869719.183007:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:3.0:1788869719.188389:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.188914:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305157504 00000100:00100000:0.0:1788869719.188928:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305157504 00000100:00100000:0.0:1788869719.189053:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1788869719.189067:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+40:15707:x1875765305157504:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869719.189147:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869719.189285:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042200/0x4c16c38a9b6d01be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2ff expref: 40 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189307:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e280839cb00) 00010000:00010000:0.0:1788869719.189319:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869719.189356:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189371:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189381:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189396:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189534:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189542:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189614:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189622:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189630:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189636:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869719.189640:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189647:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189655:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:0.0:1788869719.189658:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869719.189662:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189668:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01cc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189678:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189691:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189697:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189703:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869719.189706:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189713:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189722:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x69cb7647 (ffff8e28131c4600) 00010000:00010000:0.0:1788869719.189724:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869719.189727:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.189733:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x69cb7647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869719.189832:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+39:15707:x1875765305157504:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 769us (1453us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869719.189840:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:2.0:1788869719.193333:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869719.193540:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305157632 00000100:00100000:1.0:1788869719.193550:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305157632 00000100:00100000:1.0:1788869719.193650:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1788869719.193661:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+39:15707:x1875765305157632:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869719.193682:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869719.193709:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d01da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca306 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.193747:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.193761:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.193773:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.193903:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda600/0x4c16c38a9b6d01da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca306 expref: 41 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.193924:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca306 expref: 40 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.193934:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:1.0:1788869719.193937:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869719.193941:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edba00, rc 0) 00000100:00100000:1.0:1788869719.193999:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+40:15707:x1875765305157632:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 340us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.194013:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1788869719.199137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.199247:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305157888 00000100:00100000:2.0:1788869719.199260:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305157888 00000100:00100000:2.0:1788869719.199343:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1788869719.199354:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+40:15707:x1875765305157888:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869719.199458:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.199495:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.199508:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869719.199745:0:17099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788869719.199755:0:17099:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653113167293ns, next at 654113165033ns, rc = 0 00000004:00010000:2.0:1788869719.199804:0:17099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061cf5c44 reply state 00000000b108a7d4 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.199817:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.199827:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:2.0:1788869719.199830:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788869719.199834:0:17099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869719.199945:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+42:15707:x1875765305157888:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 593us (820us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788869719.199953:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1788869719.203127:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869719.203221:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305158016 00000100:00100000:1.0:1788869719.203233:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305158016 00000100:00100000:1.0:1788869719.203310:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1788869719.203322:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+42:15707:x1875765305158016:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869719.203349:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869719.203376:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca30d expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.203453:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca30d expref: 43 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.203469:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca30d expref: 43 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.203489:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:1.0:1788869719.203492:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869719.203496:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb200, rc 0) 00000100:00100000:1.0:1788869719.203556:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+43:15707:x1875765305158016:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 237us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.203565:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1788869719.207932:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.208026:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305158144 00000100:00100000:0.0:1788869719.208039:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305158144 00000100:00100000:0.0:1788869719.208131:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788869719.208172:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+5:2409:x1875765305158144:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788869719.208474:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+6:2409:x1875765305158144:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 333us (558us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788869719.208500:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00080000:2.0:1788869719.208740:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869719.211584:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.211789:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305158400 00000100:00100000:2.0:1788869719.211802:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305158400 00000100:00100000:2.0:1788869719.211870:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1788869719.211881:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+43:15707:x1875765305158400:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788869719.212148:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+44:15707:x1875765305158400:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 268us (573us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788869719.212157:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788869719.214579:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.214827:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305158656 00000100:00100000:2.0:1788869719.214837:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305158656 00000100:00100000:2.0:1788869719.214948:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:2.0:1788869719.214958:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+44:15707:x1875765305158656:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788869719.215071:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+44:15707:x1875765305158656:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 114us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.215079:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788869719.218547:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869719.218976:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305158784 00000100:00100000:3.0:1788869719.218987:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305158784 00000100:00100000:0.0:1788869719.219234:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:0.0:1788869719.219250:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+44:15707:x1875765305158784:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869719.219285:0:17100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869719.219308:0:17100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca314 expref: -99 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.219491:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.219509:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.219522:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869719.219579:0:17100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869719.219824:0:17100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.219856:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d01f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca314 expref: 46 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.219876:0:17100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca314 expref: 45 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.219884:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:0.0:1788869719.219887:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788869719.219898:0:17100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4200, rc 0) 00000100:00100000:0.0:1788869719.220051:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+45:15707:x1875765305158784:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 805us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869719.220060:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1788869719.223067:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.223337:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305158912 00000100:00100000:0.0:1788869719.223347:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305158912 00000100:00100000:0.0:1788869719.223507:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788869719.223521:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:893992aa-f001-4ff6-aa93-863511511bbf+6:2410:x1875765305158912:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869719.223542:0:18606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869719.223565:0:18606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca31b expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869719.223832:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffc56, blocks: 0x0 00010000:00010000:0.0:1788869719.223855:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788869719.223860:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869719.223871:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca31b expref: 7 pid: 18606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.223892:0:18606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca31b expref: 7 pid: 18606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.223905:0:18606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4c00, rc 0) 00000100:00100000:0.0:1788869719.224009:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:893992aa-f001-4ff6-aa93-863511511bbf+7:2410:x1875765305158912:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 492us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869719.224017:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1788869719.226669:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.226827:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305159168 00000100:00100000:0.0:1788869719.226862:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305159168 00000100:00100000:0.0:1788869719.226939:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:0.0:1788869719.226950:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+45:15707:x1875765305159168:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788869719.227065:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+45:15707:x1875765305159168:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 117us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869719.227072:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788869719.230282:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.230390:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305159296 00000100:00100000:2.0:1788869719.230461:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305159296 00000100:00100000:2.0:1788869719.230530:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1788869719.230541:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+45:15707:x1875765305159296:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788869719.238761:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788869719.238781:0:17078:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788869719.238858:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788869719.239035:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+20:15707:x1875765305159296:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 8489us (8768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.239047:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00010000:00010000:1.0:1788869719.239288:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239322:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239331:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239339:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.239344:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239365:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239385:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e2701ed4100) 00010000:00010000:1.0:1788869719.239389:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869719.239394:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239401:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6cffc6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239423:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239429:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239435:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239440:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.239449:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239456:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239464:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:1.0:1788869719.239467:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869719.239470:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239475:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb600/0x4c16c38a9b6cffcd lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239487:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239493:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239499:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239505:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.239508:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239513:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239520:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e28131c4400) 00010000:00010000:1.0:1788869719.239523:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869719.239532:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239538:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5800/0x4c16c38a9b6d0075 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239554:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239560:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239566:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239572:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043c00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.239575:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239582:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239627:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:1.0:1788869719.239630:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869719.239633:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239638:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043c00/0x4c16c38a9b6d00fa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239650:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239667:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239673:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239678:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.239681:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239687:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239696:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:1.0:1788869719.239699:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869719.239702:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239709:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d011d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239722:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239729:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239735:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239741:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.239749:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239756:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239765:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:1.0:1788869719.239767:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869719.239770:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239777:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0163 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239789:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239797:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239804:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239809:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.239812:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239819:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239826:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:1.0:1788869719.239829:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788869719.239836:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.239843:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d01e8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869719.242256:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325169408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788869719.242351:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869719.242579:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.242806:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325169408 00000100:00100000:2.0:1788869719.242815:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325169408 00000100:00100000:2.0:1788869719.242886:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305159424 00000100:00100000:2.0:1788869719.242890:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305159424 00000100:00100000:2.0:1788869719.242917:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869719.242928:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325169408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788869719.243068:0:18605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788869719.243072:0:18605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788869719.243088:0:18605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788869719.243090:0:18605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788869718 -> 1788869718 00002000:00010000:2.0:1788869719.243093:0:18605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788869719.243140:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325169408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (788us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788869719.243148:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869719.243166:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1788869719.243174:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+7:2410:x1875765305159424:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788869719.243235:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+7:2410:x1875765305159424:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 62us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.243243:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000004:00080000:2.0:1788869719.243295:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e270402e300/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788869719.243302:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325169408:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788869719.245089:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.245122:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.245132:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.245139:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869719.245144:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.245153:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.245193:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:2.0:1788869719.245196:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788869719.245201:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.245207:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5e00/0x4c16c38a9b6d001a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788869719.245438:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869719.249277:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.249408:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305159680 00000100:00100000:0.0:1788869719.249420:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305159680 00000100:00100000:0.0:1788869719.249497:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1788869719.249510:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+14:15707:x1875765305159680:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869719.249574:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869719.249627:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4200/0x4c16c38a9b6d01fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca314 expref: 14 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.249646:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:0.0:1788869719.249651:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869719.249681:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.249696:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.249706:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869719.249856:0:17098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c92a27fd reply state 00000000fc676175 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.249868:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.249889:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:0.0:1788869719.249891:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869719.249894:0:17098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869719.249997:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+15:15707:x1875765305159680:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 491us (742us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788869719.250004:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1788869719.252885:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.252951:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305159808 00000100:00100000:2.0:1788869719.252960:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305159808 00000100:00100000:2.0:1788869719.253016:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788869719.253026:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+7:15707:x1875765305159808:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869719.253043:0:18605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869719.253074:0:18605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca322 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.253108:0:18605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca31b expref: 8 pid: 18606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.253117:0:18605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869719.253122:0:18605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869719.253127:0:18605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 8 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.253159:0:18605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca31b expref: 8 pid: 18606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.253190:0:18605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca31b expref: 8 pid: 18606 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869719.253206:0:18605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18605:1875765325169536:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869719.253299:0:18605:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869719.261755:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.261989:0:18605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18605:1875765325169536:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869719.262022:0:18605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 8 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.262044:0:18605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042200, rc 0) 00000100:00100000:2.0:1788869719.262248:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:893992aa-f001-4ff6-aa93-863511511bbf+8:15707:x1875765305159808:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 9221us (9372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.262273:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1788869719.262398:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305159936 00000100:00100000:3.0:1788869719.262408:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305159936 00010000:00010000:3.0:1788869719.262443:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca31b expref: 8 pid: 18606 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869719.262477:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788869719.262486:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:893992aa-f001-4ff6-aa93-863511511bbf+8:2410:x1875765305159936:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869719.262519:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869719.262543:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca31b expref: 8 pid: 18606 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.262557:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca31b expref: 8 pid: 18606 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.262580:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0204 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca31b expref: 8 pid: 18606 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.262625:0:17083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869719.262630:0:17083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869719.262637:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 7 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.262647:0:17083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 7 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.262683:0:17083:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 7 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869719.262697:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17083:1875765325169664:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788869719.262748:0:17083:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a735e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869719.266537:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17083:1875765325169664:192.168.204.54@tcp:105: 00010000:00010000:1.0:1788869719.266578:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869719.266686:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:893992aa-f001-4ff6-aa93-863511511bbf+7:2410:x1875765305159936:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 4199us (4940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.266698:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788869719.271681:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.271788:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305160064 00000100:00100000:2.0:1788869719.271802:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305160064 00000100:00100000:2.0:1788869719.271879:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788869719.271891:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+7:2409:x1875765305160064:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788869719.272161:0:18604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788869719.272165:0:18604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788869716 00002000:00010000:2.0:1788869719.272167:0:18604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788869715 00002000:00010000:2.0:1788869719.272169:0:18604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788869718 -> 1788869716 00002000:00010000:2.0:1788869719.272171:0:18604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788869719.272236:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+8:2409:x1875765305160064:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 347us (567us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788869719.272274:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788869719.275285:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.275511:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305160192 00000100:00100000:0.0:1788869719.275525:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305160192 00000100:00100000:0.0:1788869719.275657:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1788869719.275671:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:893992aa-f001-4ff6-aa93-863511511bbf+8:2407:x1875765305160192:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788869719.275720:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.275747:0:18606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 8 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.275757:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869719.275764:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869719.275769:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.275812:0:18606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 8 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.275830:0:18606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 8 pid: 18605 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869719.276000:0:18606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18606:1875765325169792:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869719.276126:0:18606:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869719.279670:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.280044:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305160320 00000100:00100000:2.0:1788869719.280066:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305160320 00010000:00010000:2.0:1788869719.280120:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 9 pid: 18605 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869719.280171:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788869719.280181:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+9:2409:x1875765305160320:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869719.280198:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869719.280224:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 9 pid: 18605 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.280239:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 9 pid: 18605 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.280277:0:17085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869719.280283:0:17085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869719.280290:0:17085:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.280301:0:17085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.280323:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869719.280374:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:893992aa-f001-4ff6-aa93-863511511bbf+9:2409:x1875765305160320:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 195us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.280391:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00010000:00010000:0.0:1788869719.280988:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063579a33/0x4c16c38a9b6d0212 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca322 expref: 8 pid: 18605 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869719.281008:0:18606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18606:1875765325169792:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869719.281042:0:18606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.281063:0:18606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.281072:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.281096:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.281104:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.281112:0:18606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.281135:0:18606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869719.281139:0:18606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.281149:0:18606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.281164:0:18606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.281171:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d0219 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869719.281243:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:893992aa-f001-4ff6-aa93-863511511bbf+7:2407:x1875765305160192:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 5576us (5966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869719.281252:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:3.0:1788869719.288610:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.288832:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305160576 00000100:00100000:0.0:1788869719.288852:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305160576 00000100:00100000:0.0:1788869719.288931:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:0.0:1788869719.288942:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+15:15707:x1875765305160576:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788869719.289038:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.289061:0:17100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c0 expref: 15 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.289091:0:17100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.289129:0:17100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c0 expref: 15 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869719.289144:0:17100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c0 expref: 15 pid: 19213 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869719.289158:0:17100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e28179e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17100:1875765325169920:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869719.289238:0:17100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869719.294770:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869719.294856:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305160704 00000100:00100000:3.0:1788869719.294867:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305160704 00010000:00010000:3.0:1788869719.294913:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c0 expref: 16 pid: 19213 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869719.294998:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1788869719.295009:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:893992aa-f001-4ff6-aa93-863511511bbf+16:2410:x1875765305160704:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869719.295026:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869719.295033:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c0 expref: 16 pid: 19213 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.295048:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c0 expref: 16 pid: 19213 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.295083:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869719.295090:0:17083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f1 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.295101:0:17083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.295118:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.295126:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.295150:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869719.295229:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:893992aa-f001-4ff6-aa93-863511511bbf+16:2410:x1875765305160704:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 222us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869719.295237:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00010000:00010000:0.0:1788869719.296686:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d00f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2c0 expref: 15 pid: 19213 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869719.296715:0:17100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e28179e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17100:1875765325169920:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869719.296758:0:17100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.297552:0:17100:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.297564:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.297870:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.297887:0:17100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca30d expref: 15 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.297896:0:17100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.297939:0:17100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca30d expref: 15 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.297956:0:17100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca30d expref: 15 pid: 17100 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869719.297971:0:17100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17100:1875765325170048:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869719.298930:0:17100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869719.304909:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.305128:0:17100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17100:1875765325170048:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869719.305163:0:17100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869719.305315:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305160832 00000100:00100000:3.0:1788869719.305324:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305160832 00010000:00010000:3.0:1788869719.305369:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca30d expref: 16 pid: 17100 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869719.305407:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1788869719.305416:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27025f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:893992aa-f001-4ff6-aa93-863511511bbf+16:2409:x1875765305160832:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869719.305433:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869719.305441:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca30d expref: 16 pid: 17100 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.305455:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca30d expref: 16 pid: 17100 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.305481:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb200/0x4c16c38a9b6d01ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca30d expref: 16 pid: 17100 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.305498:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:3.0:1788869719.305502:0:17084:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.305512:0:17084:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.305522:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.305566:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869719.305664:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27025f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:893992aa-f001-4ff6-aa93-863511511bbf+15:2409:x1875765305160832:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 248us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869719.305673:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00010000:00010000:1.0:1788869719.305781:0:17100:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.305790:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869719.305929:0:17100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1788869719.306059:0:17100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1788869719.306101:0:17100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1788869719.306195:0:17100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17100:1875765325170176:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788869719.306254:0:17100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869719.306303:0:17100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869719.307023:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325170176 00000100:00100000:3.0:1788869719.307032:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325170176 00000100:00100000:3.0:1788869719.307089:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788869719.307098:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17100:x1875765325170176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788869719.307194:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17100:x1875765325170176:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869719.307201:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788869719.307359:0:17100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17100:1875765325170176:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788869719.307553:0:17100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788869719.307641:0:17100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17100:1875765325170304:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788869719.307677:0:17100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869719.307757:0:17100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869719.308978:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325170304 00000100:00100000:2.0:1788869719.308993:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325170304 00000100:00100000:2.0:1788869719.309056:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788869719.309065:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17100:x1875765325170304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788869719.309376:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17100:x1875765325170304:12345-0@lo:1000:mdt00_002.0 Request processed in 311us (1698us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788869719.309385:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788869719.309549:0:17100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17100:1875765325170304:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788869719.309707:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309719:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309727:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309733:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.309739:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309746:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309765:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:1.0:1788869719.309768:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869719.309774:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309780:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043800/0x4c16c38a9b6d0227 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309813:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309834:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309920:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309925:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869719.309929:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309936:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309945:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:1.0:1788869719.309948:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869719.309955:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f1 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309968:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f1 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.309977:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f1 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.310011:0:17100:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f1 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869719.310026:0:17100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17100:1875765325170432:192.168.204.54@tcp:105: 00000100:00100000:1.0:1788869719.310311:0:17100:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1788869719.316697:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.316864:0:17100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17100:1875765325170432:192.168.204.54@tcp:105: 00010000:00010000:2.0:1788869719.316896:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.316907:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d017f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.316945:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.316961:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.316973:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.316985:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.316991:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317020:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317026:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869719.317031:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317039:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317061:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869719.317065:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869719.317069:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317074:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d022e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317085:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317091:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317097:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317102:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869719.317105:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317453:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317464:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:2.0:1788869719.317466:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869719.317469:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.317475:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0220 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869719.317712:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+18:15707:x1875765305160576:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 28771us (29132us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788869719.317725:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000020:00080000:2.0:1788869719.317731:0:17100:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788869719.320143:0:17132:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788869719.320155:0:17132:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869719.320175:0:17132:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788869719.320182:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788869719.320965:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305160960 00000100:00100000:3.0:1788869719.320979:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305160960 00000100:00100000:2.0:1788869719.321281:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788869719.321294:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+18:15706:x1875765305160960:12345-192.168.204.54@tcp:49:bash.0 00000100:00100000:2.0:1788869719.321448:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+18:15706:x1875765305160960:12345-192.168.204.54@tcp:49:bash.0 Request processed in 157us (4763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.321456:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869719.321725:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869719.324863:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869719.325027:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305161344 00000100:00100000:1.0:1788869719.325038:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305161344 00000100:00100000:1.0:1788869719.325120:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1788869719.325133:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+7:15706:x1875765305161344:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869719.325158:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869719.325185:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6d0235 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca329 expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869719.325218:0:18991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ffc54, atime: 0x6a9ffc53, ctime: 0x6a9ffc54, blocks: 0x0 00010000:00010000:1.0:1788869719.325242:0:18991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788869719.325248:0:18991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869719.325270:0:18991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6d0235 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca329 expref: 8 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.325290:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6d0235 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca329 expref: 8 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.325302:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda600, rc 0) 00000100:00100000:1.0:1788869719.325387:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+8:15706:x1875765305161344:12345-192.168.204.54@tcp:101:bash.0 Request processed in 257us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.325394:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1788869719.328434:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869719.328570:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305161472 00000100:00100000:3.0:1788869719.328583:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305161472 00000100:00100000:3.0:1788869719.328689:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:3.0:1788869719.328699:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+18:15706:x1875765305161472:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788869719.328724:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869719.328744:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d023c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca330 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.328776:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6d0243 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.328791:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6d0243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.328819:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6d0243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.328951:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d023c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca330 expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.328970:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6d0243 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca330 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.328978:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869719.328981:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869719.328984:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8e00, rc 0) 00000100:00100000:3.0:1788869719.329041:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+19:15706:x1875765305161472:12345-192.168.204.54@tcp:101:bash.0 Request processed in 344us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869719.329048:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:0.0:1788869719.332286:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305161216 00000100:00100000:0.0:1788869719.332302:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305161216 00000100:00100000:0.0:1788869719.332405:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788869719.332418:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+19:15707:x1875765305161216:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788869719.335419:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000004:00080000:1.0:1788869719.335671:0:17102:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788869719.335710:0:17102:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1788869719.335778:0:17102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.335797:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.335811:0:17102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.335820:0:17102:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.335827:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.335834:0:17102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869719.335950:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305161728 00000100:00100000:2.0:1788869719.335961:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305161728 00010000:00010000:1.0:1788869719.336145:0:17102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788869719.336273:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+22:15707:x1875765305161216:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 3845us (14535us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1788869719.336286:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000020:00080000:1.0:1788869719.336293:0:17102:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788869719.336318:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788869719.336329:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+21:15706:x1875765305161728:12345-192.168.204.54@tcp:35:bash.0 00000001:00080000:1.0:1788869719.336521:0:17102:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:1.0:1788869719.336659:0:17102:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:1.0:1788869719.336711:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:893992aa-f001-4ff6-aa93-863511511bbf+24:15706:x1875765305161728:12345-192.168.204.54@tcp:35:bash.0 Request processed in 384us (1303us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1788869719.336719:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000020:00080000:1.0:1788869719.336722:0:17102:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788869719.340123:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869719.340144:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.340157:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869719.340162:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.340175:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.340199:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:3.0:1788869719.340203:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788869719.340227:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.340233:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d024a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.340355:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869719.340358:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869719.340361:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869719.433573:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.434193:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305161984 00000100:00100000:2.0:1788869719.434207:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305161984 00000100:00100000:2.0:1788869719.434360:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:2.0:1788869719.434392:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+24:15717:x1875765305161984:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869719.434426:0:19213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869719.434452:0:19213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d0251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca337 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869719.434632:0:19213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788869719.434754:0:19213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d0251 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca337 expref: 26 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.434770:0:19213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:2.0:1788869719.434773:0:19213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869719.434778:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042400/0x4c16c38a9b6d0251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca337 expref: 26 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.434793:0:19213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042400, rc 0) 00000100:00100000:2.0:1788869719.435044:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:893992aa-f001-4ff6-aa93-863511511bbf+25:15717:x1875765305161984:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 655us (1484us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788869719.435053:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:2.0:1788869719.438663:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869719.438937:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305162112 00000100:00100000:3.0:1788869719.438948:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305162112 00000100:00100000:3.0:1788869719.439015:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1788869719.439026:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+25:15717:x1875765305162112:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1788869719.440004:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440031:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440045:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440065:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440071:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440078:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440328:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440395:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440427:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869719.440493:0:17098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440509:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440516:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440523:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440529:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8c00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869719.440534:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440542:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440555:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:3.0:1788869719.440558:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869719.440563:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440569:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8c00/0x4c16c38a9b6d025f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440584:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440664:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440671:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440677:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869719.440680:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440687:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440695:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e2703661600) 00010000:00010000:3.0:1788869719.440697:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869719.440700:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440705:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0266 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440720:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440726:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440732:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440737:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869719.440746:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440752:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440760:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869719.440762:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869719.440764:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.440771:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d026d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869719.440997:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+25:15717:x1875765305162112:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1968us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869719.441008:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1788869719.444004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.444101:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305162368 00000100:00100000:2.0:1788869719.444168:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305162368 00000100:00100000:2.0:1788869719.444299:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788869719.444312:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+25:15717:x1875765305162368:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788869719.444580:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+26:15717:x1875765305162368:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 270us (587us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788869719.447091:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1788869719.496676:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.496726:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869719.496880:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305162496 00000100:00100000:3.0:1788869719.496893:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305162496 00000100:00100000:3.0:1788869719.496957:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:3.0:1788869719.496969:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+13:2408:x1875765305162496:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869719.497049:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+13:2408:x1875765305162496:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 82us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869719.497057:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:1.0:1788869719.497751:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305162624 00000100:00100000:1.0:1788869719.497760:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305162624 00000100:00100000:1.0:1788869719.497824:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1788869719.497833:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:2408:x1875765305162624:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869719.497893:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:2408:x1875765305162624:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 62us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.497900:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00080000:3.0:1788869719.498310:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869719.500149:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.500193:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869719.500287:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305163136 00000100:00100000:2.0:1788869719.500296:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305163136 00000100:00100000:2.0:1788869719.500396:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1788869719.500407:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305163136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869719.500494:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305163136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 89us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.500503:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00080000:3.0:1788869719.501020:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869719.501086:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305162880 00000100:00100000:1.0:1788869719.501092:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305162880 00000100:00100000:1.0:1788869719.501156:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788869719.501165:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2407:x1875765305162880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869719.501222:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2407:x1875765305162880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 59us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.501229:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00080000:3.0:1788869719.501332:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869719.514401:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.514448:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869719.514490:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869719.514622:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305162752 00000100:00100000:3.0:1788869719.514632:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305162752 00000100:00100000:3.0:1788869719.514701:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305163264 00000100:00100000:3.0:1788869719.514720:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305163264 00000100:00100000:3.0:1788869719.514766:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1788869719.514776:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+5:2407:x1875765305162752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869719.514870:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+5:2407:x1875765305162752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 95us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869719.514878:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1788869719.514898:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788869719.514905:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305163264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869719.514928:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305163264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869719.514934:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00080000:0.0:1788869719.515057:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869719.515281:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305163008 00000100:00100000:2.0:1788869719.515287:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305163008 00000100:00080000:0.0:1788869719.515659:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869719.515769:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1788869719.515779:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305163008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869719.515843:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2407:x1875765305163008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 66us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869719.515850:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00010000:00010000:3.0:1788869719.623518:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869720.389885:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869720.389909:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325170560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869720.389986:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869720.390096:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325170560 00000100:00100000:1.0:1788869720.390105:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325170560 00000100:00100000:1.0:1788869720.390188:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869720.390199:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325170560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869720.390231:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788869720.390294:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325170560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869720.390302:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788869720.390466:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869720.390506:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325170560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869720.390901:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325171072:0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.390940:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869720.390970:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325171584:0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.390996:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869720.391015:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325172096:0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.391038:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869720.391065:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788869720.391071:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325170944:0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.391092:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869720.391112:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325171456:0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.391132:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869720.391165:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325171968:0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.391189:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869720.391218:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325171072 00000100:00100000:3.0:1788869720.391224:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325171072 00000100:00100000:3.0:1788869720.391274:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325170944 00000100:00100000:3.0:1788869720.391277:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325170944 00000100:00100000:3.0:1788869720.391288:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325171456 00000100:00100000:3.0:1788869720.391290:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325171456 00000100:00100000:3.0:1788869720.391302:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869720.391309:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325171072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391415:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325170816:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391448:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869720.391471:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325171328:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391492:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869720.391510:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325171840:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391531:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869720.391549:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788869720.391553:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325170688:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391582:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869720.391632:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325171200:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391654:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869720.391665:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325171712:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391681:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869720.391701:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325170816 00000100:00100000:2.0:1788869720.391704:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325170816 00000100:00100000:2.0:1788869720.391730:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325171328 00000100:00100000:2.0:1788869720.391733:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325171328 00000100:00100000:2.0:1788869720.391760:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869720.391765:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325170816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391811:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325170816:12345-0@lo:400:kworker.0 Request processed in 45us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869720.391817:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869720.391831:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869720.391837:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325171328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391863:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325171328:12345-0@lo:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869720.391869:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869720.391886:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325170688 00000100:00100000:2.0:1788869720.391890:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325170688 00000100:00100000:2.0:1788869720.391914:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788869720.391919:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3651:x1875765325170688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391944:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3651:x1875765325170688:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869720.391950:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788869720.391985:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325170688:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.391995:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325170816:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.392002:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325171328:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.392023:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325171584 00000100:00100000:2.0:1788869720.392026:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325171584 00000100:00100000:2.0:1788869720.392042:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325172096 00000100:00100000:2.0:1788869720.392044:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325172096 00000100:00100000:2.0:1788869720.392054:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325171968 00000100:00100000:2.0:1788869720.392056:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325171968 00000100:00100000:2.0:1788869720.392073:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325171840 00000100:00100000:2.0:1788869720.392075:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325171840 00000100:00100000:2.0:1788869720.392083:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325171200 00000100:00100000:2.0:1788869720.392084:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325171200 00000100:00100000:2.0:1788869720.392091:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325171712 00000100:00100000:2.0:1788869720.392093:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325171712 00000100:00100000:2.0:1788869720.392103:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869720.392107:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325171584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.392135:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325171584:12345-0@lo:400:kworker.0 Request processed in 28us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869720.392141:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869720.392151:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869720.392156:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325172096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.392179:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325172096:12345-0@lo:400:kworker.0 Request processed in 24us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869720.392184:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869720.392193:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869720.392197:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325171968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.392218:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325171968:12345-0@lo:400:kworker.0 Request processed in 21us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869720.392224:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869720.392233:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869720.392250:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325171840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.392278:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325171840:12345-0@lo:400:kworker.0 Request processed in 41us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869720.392284:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788869720.392306:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2702654e00 x1875765325171840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869720.392595:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325171072:12345-0@lo:400:kworker.0 Request processed in 1275us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869720.392604:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869720.392619:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869720.392625:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325170944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.392651:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1875765325170944:12345-0@lo:400:kworker.0 Request processed in 26us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869720.392656:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869720.392673:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869720.392678:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325171456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.392703:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325171456:12345-0@lo:400:kworker.0 Request processed in 25us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869720.392708:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869720.392725:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788869720.392731:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325171200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.392756:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325171200:12345-0@lo:400:kworker.0 Request processed in 25us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869720.392761:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788869720.392773:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869720.392778:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325171712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869720.393302:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325171712:12345-0@lo:400:kworker.0 Request processed in 38us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869720.393309:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869720.393419:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325171840:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.393455:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325171200:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.393467:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325171712:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.393504:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325170944:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.393518:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325171456:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.393531:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325171968:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.393542:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325171072:0@lo:400:kworker.0 00000100:00100000:2.0:1788869720.393552:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325171584:0@lo:400:kworker.0 00010000:00080000:2.0:1788869720.393564:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2702656300 x1875765325172096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869720.393575:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325172096:0@lo:400:kworker.0 00000100:00080000:3.0:1788869720.393706:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869720.393712:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869720.393715:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869720.393718:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869720.394267:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2840f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325172224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869720.394320:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869720.394572:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325172224 00000100:00100000:1.0:1788869720.394580:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325172224 00000100:00100000:1.0:1788869720.394641:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869720.394651:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325172224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869720.394684:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788869720.394733:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325172224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869720.394741:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869720.395316:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2840f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325172224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788869720.650446:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869720.905323:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325172352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869720.905411:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869720.905484:0:20240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325172352 00000100:00100000:0.0:1788869720.905492:0:20240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325172352 00000100:00100000:0.0:1788869720.905570:0:20240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869720.905582:0:20240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325172352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869720.905659:0:20240:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788869720.905710:0:20240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325172352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869720.905717:0:20240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869720.905771:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325172352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869720.909205:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325172480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869720.909305:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869720.909374:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325172480 00000100:00100000:2.0:1788869720.909381:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325172480 00000100:00100000:2.0:1788869720.909429:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869720.909439:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875765325172480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869720.909461:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788869720.909508:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282db34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875765325172480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869720.909525:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869720.909578:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325172480:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788869721.107865:0:20278:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:0.0:1788869721.413952:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869721.413978:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325172608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869721.414058:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869721.415847:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325172608 00000100:00100000:2.0:1788869721.415864:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325172608 00000100:00100000:2.0:1788869721.415926:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869721.415938:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325172608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869721.415987:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788869721.416092:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325172608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869721.416099:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788869721.416850:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325172608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869721.418120:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325172736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869721.418186:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869721.418583:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325172736 00000100:00100000:0.0:1788869721.418849:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325172736 00000100:00100000:0.0:1788869721.418914:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788869721.418924:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325172736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869721.418962:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869721.419080:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325172736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869721.419089:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788869721.424952:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e284111df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325172736:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869721.670091:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869722.373923:0:17132:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788869722.373933:0:17132:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869722.373951:0:17132:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788869722.373960:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788869722.561319:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869722.561474:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869722.561515:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305163520 00000100:00100000:3.0:1788869722.561544:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305163520 00000100:00100000:3.0:1788869722.561644:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1788869722.561657:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+8:2407:x1875765305163520:12345-192.168.204.54@tcp:16:kworker.0 00000100:00100000:3.0:1788869722.561802:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+8:2407:x1875765305163520:12345-192.168.204.54@tcp:16:kworker.0 Request processed in 147us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869722.561811:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00080000:3.0:1788869722.561836:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869722.565850:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305163392 00000100:00100000:0.0:1788869722.565867:0:18610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305163392 00002000:00100000:0.0:1788869722.565929:0:18610:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff8e2702655c00 x1875765305163392/t0(0) o4->893992aa-f001-4ff6-aa93-863511511bbf@192.168.204.54@tcp:668/0 lens 504/0 e 0 to 0 dl 1788869733 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788869722.565941:0:18610:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2702655c00 with x1875765305163392 ext(0->8) 00002000:00010000:0.0:1788869722.565946:0:18610:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2702655c00 00000100:00100000:0.0:1788869722.566194:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788869722.566221:0:18610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:893992aa-f001-4ff6-aa93-863511511bbf+8:2407:x1875765305163392:12345-192.168.204.54@tcp:4:bash.0 00000100:00100000:0.0:1788869722.570158:0:18610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:893992aa-f001-4ff6-aa93-863511511bbf+10:2407:x1875765305163392:12345-192.168.204.54@tcp:4:bash.0 Request processed in 3931us (8839us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788869722.570172:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:0.0:1788869722.570186:0:18610:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff8e2702655c00 x1875765305163392/t8589934599(0) o4->893992aa-f001-4ff6-aa93-863511511bbf@192.168.204.54@tcp:668/0 lens 504/448 e 0 to 0 dl 1788869733 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788869722.570206:0:18610:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2702655c00 with x1875765305163392 ext(0->8) 00002000:00010000:0.0:1788869722.570213:0:18610:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2702655c00 00010000:00010000:2.0:1788869722.700295:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 44374 lines, 44374 kept, 0 dropped, 0 bad.